Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning
Identifying of yak is indispensable for individual documentation, behavior monitoring, precise feeding, disease prevention and control, food traceability, and individualized breeding. Aiming at the application requirements of animal individual identification technology in intelligent informatization...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Editorial Office of Smart Agriculture
2022-06-01
|
| Series: | 智慧农业 |
| Subjects: | |
| Online Access: | http://www.smartag.net.cn/article/2022/2096-8094/2096-8094-2022-4-2-77.shtml |
| _version_ | 1811221030486671360 |
|---|---|
| author | CHEN Zhanqi ZHANG Yu'an WANG Wenzhi LI Dan HE Jie SONG Rende |
| author_facet | CHEN Zhanqi ZHANG Yu'an WANG Wenzhi LI Dan HE Jie SONG Rende |
| author_sort | CHEN Zhanqi |
| collection | DOAJ |
| description | Identifying of yak is indispensable for individual documentation, behavior monitoring, precise feeding, disease prevention and control, food traceability, and individualized breeding. Aiming at the application requirements of animal individual identification technology in intelligent informatization animal breeding platforms, a yak face recognition algorithm based on transfer learning and multiscale feature fusion, i.e., transfer learning-multiscale feature fusion-VGG(T-M-VGG) was proposed. The sample data set of yak facial images was produced by a camera named GoPro HERO8 BLACK. Then, a part of dataset was increased by the data enhancement ways that involved rotating, adjusting the brightness and adding noise to improve the robustness and accuracy of model. T-M-VGG, a kind of convolutional neural network based on pre-trained visual geometry group network and transfer learning was input with normalized dataset samples. The feature map of Block3, Block4 and Block5 were considered as F3, F4 and F5, respectively. What's more, F3 and F5 were taken by the structure that composed of three parallel dilated convolutions, the dilation rate were one, two and three, respectively, to dilate the receptive filed which was the map size of feature map. Further, the multiscale feature maps were fused by the improved feature pyramid which was in the shape of stacked hourglass structure. Finally, the fully connected layer was replaced by the global average pooling to classify and reduce a large number of parameters. To verify the effectiveness of the proposed model, a comparative experiment was conducted. The experimental results showed that recognition accuracy rate in 38,800 data sets of 194 yaks reached 96.01%, but the storage size was 70.75 MB. Twelve images representing different yak categories from dataset were chosen randomly for occlusion test. The origin images were masked with different shape of occlusions. The accuracy of identifying yak individuals was 83.33% in the occlusion test, which showed that the model had mainly learned facial features. The proposed algorithm could provide a reference for research of yak face recognition and would be the foundation for the establishment of smart management platform. |
| first_indexed | 2024-04-12T07:52:43Z |
| format | Article |
| id | doaj.art-dea4943fe1d24d3aa0bad3d68b6312ed |
| institution | Directory Open Access Journal |
| issn | 2096-8094 |
| language | English |
| last_indexed | 2024-04-12T07:52:43Z |
| publishDate | 2022-06-01 |
| publisher | Editorial Office of Smart Agriculture |
| record_format | Article |
| series | 智慧农业 |
| spelling | doaj.art-dea4943fe1d24d3aa0bad3d68b6312ed2022-12-22T03:41:34ZengEditorial Office of Smart Agriculture智慧农业2096-80942022-06-0142778510.12133/j.smartag.SA202201001SA202201001Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer LearningCHEN Zhanqi0ZHANG Yu'an1WANG Wenzhi2LI Dan3HE Jie4SONG Rende5Department of Computer Technology and Application, Qinghai University, Xining 810016, ChinaDepartment of Computer Technology and Application, Qinghai University, Xining 810016, ChinaDepartment of Computer Technology and Application, Qinghai University, Xining 810016, ChinaDepartment of Computer Technology and Application, Qinghai University, Xining 810016, ChinaDepartment of Computer Technology and Application, Qinghai University, Xining 810016, ChinaAnimal Disease Prevention and Control Center of Yushu Tibetan Autonomous Prefecture, Yushu 815000, ChinaIdentifying of yak is indispensable for individual documentation, behavior monitoring, precise feeding, disease prevention and control, food traceability, and individualized breeding. Aiming at the application requirements of animal individual identification technology in intelligent informatization animal breeding platforms, a yak face recognition algorithm based on transfer learning and multiscale feature fusion, i.e., transfer learning-multiscale feature fusion-VGG(T-M-VGG) was proposed. The sample data set of yak facial images was produced by a camera named GoPro HERO8 BLACK. Then, a part of dataset was increased by the data enhancement ways that involved rotating, adjusting the brightness and adding noise to improve the robustness and accuracy of model. T-M-VGG, a kind of convolutional neural network based on pre-trained visual geometry group network and transfer learning was input with normalized dataset samples. The feature map of Block3, Block4 and Block5 were considered as F3, F4 and F5, respectively. What's more, F3 and F5 were taken by the structure that composed of three parallel dilated convolutions, the dilation rate were one, two and three, respectively, to dilate the receptive filed which was the map size of feature map. Further, the multiscale feature maps were fused by the improved feature pyramid which was in the shape of stacked hourglass structure. Finally, the fully connected layer was replaced by the global average pooling to classify and reduce a large number of parameters. To verify the effectiveness of the proposed model, a comparative experiment was conducted. The experimental results showed that recognition accuracy rate in 38,800 data sets of 194 yaks reached 96.01%, but the storage size was 70.75 MB. Twelve images representing different yak categories from dataset were chosen randomly for occlusion test. The origin images were masked with different shape of occlusions. The accuracy of identifying yak individuals was 83.33% in the occlusion test, which showed that the model had mainly learned facial features. The proposed algorithm could provide a reference for research of yak face recognition and would be the foundation for the establishment of smart management platform.http://www.smartag.net.cn/article/2022/2096-8094/2096-8094-2022-4-2-77.shtmlyakface recognitiontransfer learningfeature pyramid structuret-m-vgg |
| spellingShingle | CHEN Zhanqi ZHANG Yu'an WANG Wenzhi LI Dan HE Jie SONG Rende Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning 智慧农业 yak face recognition transfer learning feature pyramid structure t-m-vgg |
| title | Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning |
| title_full | Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning |
| title_fullStr | Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning |
| title_full_unstemmed | Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning |
| title_short | Multiscale Feature Fusion Yak Face Recognition Algorithm Based on Transfer Learning |
| title_sort | multiscale feature fusion yak face recognition algorithm based on transfer learning |
| topic | yak face recognition transfer learning feature pyramid structure t-m-vgg |
| url | http://www.smartag.net.cn/article/2022/2096-8094/2096-8094-2022-4-2-77.shtml |
| work_keys_str_mv | AT chenzhanqi multiscalefeaturefusionyakfacerecognitionalgorithmbasedontransferlearning AT zhangyuan multiscalefeaturefusionyakfacerecognitionalgorithmbasedontransferlearning AT wangwenzhi multiscalefeaturefusionyakfacerecognitionalgorithmbasedontransferlearning AT lidan multiscalefeaturefusionyakfacerecognitionalgorithmbasedontransferlearning AT hejie multiscalefeaturefusionyakfacerecognitionalgorithmbasedontransferlearning AT songrende multiscalefeaturefusionyakfacerecognitionalgorithmbasedontransferlearning |