Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+
Wheat, one of the most important food crops in the world, is usually harvested mechanically by combine harvesters. The impurity rate is one of the most important indicators of the quality of wheat obtained by mechanized harvesting. To realize the online detection of the impurity rate in the mechaniz...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-10-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/19/7627 |
| _version_ | 1797476842445209600 |
|---|---|
| author | Man Chen Chengqian Jin Youliang Ni Jinshan Xu Tengxiang Yang |
| author_facet | Man Chen Chengqian Jin Youliang Ni Jinshan Xu Tengxiang Yang |
| author_sort | Man Chen |
| collection | DOAJ |
| description | Wheat, one of the most important food crops in the world, is usually harvested mechanically by combine harvesters. The impurity rate is one of the most important indicators of the quality of wheat obtained by mechanized harvesting. To realize the online detection of the impurity rate in the mechanized harvesting process of wheat, a vision system based on the DeepLabV3+ model of deep learning for identifying and segmenting wheat grains and impurities was designed in this study. The DeepLabV3+ model construction considered the four backbones of MobileNetV2, Xception-65, ResNet-50, and ResNet-101 for training. The optimal DeepLabV3+ model was determined through the accuracy rate, comprehensive evaluation index, and average intersection ratio. On this basis, an online detection method of measuring the wheat impurity rate in mechanized harvesting based on image information was constructed. The model realized the online detection of the wheat impurity rate. The test results showed that ResNet-50 had the best recognition and segmentation performance; the accuracy rate of grain identification was 86.86%; the comprehensive evaluation index was 83.63%; the intersection ratio was 0.7186; the accuracy rate of impurity identification was 89.91%; the comprehensive evaluation index was 87.18%; the intersection ratio was 0.7717; and the average intersection ratio was 0.7457. In terms of speed, ResNet-50 had a fast segmentation speed of 256 ms per image. Therefore, in this study, ResNet-50 was selected as the backbone network for DeepLabV3+ to carry out the identification and segmentation of mechanically harvested wheat grains and impurity components. Based on the manual inspection results, the maximum absolute error of the device impurity rate detection in the bench test was 0.2%, and the largest relative error was 17.34%; the maximum absolute error of the device impurity rate detection in the field test was 0.06%; and the largest relative error was 13.78%. This study provides a real-time method for impurity rate measurement in wheat mechanized harvesting. |
| first_indexed | 2024-03-09T21:09:30Z |
| format | Article |
| id | doaj.art-bb47dffb4af04b4aac9f1ca6e58a5e8e |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T21:09:30Z |
| publishDate | 2022-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-bb47dffb4af04b4aac9f1ca6e58a5e8e2023-11-23T21:52:14ZengMDPI AGSensors1424-82202022-10-012219762710.3390/s22197627Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+Man Chen0Chengqian Jin1Youliang Ni2Jinshan Xu3Tengxiang Yang4Nanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing 210014, ChinaNanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing 210014, ChinaNanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing 210014, ChinaNanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing 210014, ChinaNanjing Institute of Agricultural Mechanization, Ministry of Agriculture and Rural Affairs, Nanjing 210014, ChinaWheat, one of the most important food crops in the world, is usually harvested mechanically by combine harvesters. The impurity rate is one of the most important indicators of the quality of wheat obtained by mechanized harvesting. To realize the online detection of the impurity rate in the mechanized harvesting process of wheat, a vision system based on the DeepLabV3+ model of deep learning for identifying and segmenting wheat grains and impurities was designed in this study. The DeepLabV3+ model construction considered the four backbones of MobileNetV2, Xception-65, ResNet-50, and ResNet-101 for training. The optimal DeepLabV3+ model was determined through the accuracy rate, comprehensive evaluation index, and average intersection ratio. On this basis, an online detection method of measuring the wheat impurity rate in mechanized harvesting based on image information was constructed. The model realized the online detection of the wheat impurity rate. The test results showed that ResNet-50 had the best recognition and segmentation performance; the accuracy rate of grain identification was 86.86%; the comprehensive evaluation index was 83.63%; the intersection ratio was 0.7186; the accuracy rate of impurity identification was 89.91%; the comprehensive evaluation index was 87.18%; the intersection ratio was 0.7717; and the average intersection ratio was 0.7457. In terms of speed, ResNet-50 had a fast segmentation speed of 256 ms per image. Therefore, in this study, ResNet-50 was selected as the backbone network for DeepLabV3+ to carry out the identification and segmentation of mechanically harvested wheat grains and impurity components. Based on the manual inspection results, the maximum absolute error of the device impurity rate detection in the bench test was 0.2%, and the largest relative error was 17.34%; the maximum absolute error of the device impurity rate detection in the field test was 0.06%; and the largest relative error was 13.78%. This study provides a real-time method for impurity rate measurement in wheat mechanized harvesting.https://www.mdpi.com/1424-8220/22/19/7627wheatimpurity ratedynamic detectionimage segmentationDeepLabV3+ |
| spellingShingle | Man Chen Chengqian Jin Youliang Ni Jinshan Xu Tengxiang Yang Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+ Sensors wheat impurity rate dynamic detection image segmentation DeepLabV3+ |
| title | Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+ |
| title_full | Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+ |
| title_fullStr | Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+ |
| title_full_unstemmed | Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+ |
| title_short | Online Detection System for Wheat Machine Harvesting Impurity Rate Based on DeepLabV3+ |
| title_sort | online detection system for wheat machine harvesting impurity rate based on deeplabv3 |
| topic | wheat impurity rate dynamic detection image segmentation DeepLabV3+ |
| url | https://www.mdpi.com/1424-8220/22/19/7627 |
| work_keys_str_mv | AT manchen onlinedetectionsystemforwheatmachineharvestingimpurityratebasedondeeplabv3 AT chengqianjin onlinedetectionsystemforwheatmachineharvestingimpurityratebasedondeeplabv3 AT youliangni onlinedetectionsystemforwheatmachineharvestingimpurityratebasedondeeplabv3 AT jinshanxu onlinedetectionsystemforwheatmachineharvestingimpurityratebasedondeeplabv3 AT tengxiangyang onlinedetectionsystemforwheatmachineharvestingimpurityratebasedondeeplabv3 |