Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4
It is difficult to extract small and dense objects with random state, such as grain and impurity, in image of vehicle-mounted dynamic rice grain flow on combine harvester. Therefore, this paper improves Deeplabv3+ by constructing MobileNetv2 in coding layer and adding ECA(Efficient Channe...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10124771/ |
| _version_ | 1797820014260125696 |
|---|---|
| author | Qian Zhang Jinpeng Hu Lizhang Xu Qibing Cai Xun Yu Peng Liu |
| author_facet | Qian Zhang Jinpeng Hu Lizhang Xu Qibing Cai Xun Yu Peng Liu |
| author_sort | Qian Zhang |
| collection | DOAJ |
| description | It is difficult to extract small and dense objects with random state, such as grain and impurity, in image of vehicle-mounted dynamic rice grain flow on combine harvester. Therefore, this paper improves Deeplabv3+ by constructing MobileNetv2 in coding layer and adding ECA(Efficient Channel Attention) to Encoder and Decoder to improve extraction accuracy of high-dimensional features in images with a large number of objects with random state. In addition, the YOLOv4 is improved by using Mixup in preprocessing, constructing Mish in Neck and Head, adding ECA to Neck and Prediction of BackBone to improve training precision of small and dense objects and reducing effect of gradient disappearance. And the impurity/breakage rates are assessed based on relationship model between pixel area and quality, improved Deeplabv3+ and YOLOv4. The proposed method was verified by experiments with images acquired on intelligent combine harvester. Compared with existing Deeplabv3+, YOLOv4, U-NET, BP, the extraction accuracy by improved method increased by more than 4.01%. The average relative error and time of impurity/breakage assessment by proposed method were 7.69% and 1.56s. The proposed method can accurately and rapidly assess impurity/breakage rates for dynamic rice grain flow on combine harvester, and further realize closed-loop control of intelligent harvesting operation. |
| first_indexed | 2024-03-13T09:31:09Z |
| format | Article |
| id | doaj.art-26403b21275b49a6ba649702de0e6f11 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T09:31:09Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-26403b21275b49a6ba649702de0e6f112023-05-25T23:00:47ZengIEEEIEEE Access2169-35362023-01-0111492734928810.1109/ACCESS.2023.327645010124771Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4Qian Zhang0https://orcid.org/0000-0002-9045-7519Jinpeng Hu1Lizhang Xu2Qibing Cai3Xun Yu4Peng Liu5https://orcid.org/0000-0001-7403-7795School of Agricultural Engineering, Jiangsu University, Zhenjiang, ChinaSchool of Agricultural Engineering, Jiangsu University, Zhenjiang, ChinaSchool of Agricultural Engineering, Jiangsu University, Zhenjiang, ChinaSchool of Agricultural Engineering, Jiangsu University, Zhenjiang, ChinaSchool of Agricultural Engineering, Jiangsu University, Zhenjiang, ChinaSchool of Agricultural Engineering, Jiangsu University, Zhenjiang, ChinaIt is difficult to extract small and dense objects with random state, such as grain and impurity, in image of vehicle-mounted dynamic rice grain flow on combine harvester. Therefore, this paper improves Deeplabv3+ by constructing MobileNetv2 in coding layer and adding ECA(Efficient Channel Attention) to Encoder and Decoder to improve extraction accuracy of high-dimensional features in images with a large number of objects with random state. In addition, the YOLOv4 is improved by using Mixup in preprocessing, constructing Mish in Neck and Head, adding ECA to Neck and Prediction of BackBone to improve training precision of small and dense objects and reducing effect of gradient disappearance. And the impurity/breakage rates are assessed based on relationship model between pixel area and quality, improved Deeplabv3+ and YOLOv4. The proposed method was verified by experiments with images acquired on intelligent combine harvester. Compared with existing Deeplabv3+, YOLOv4, U-NET, BP, the extraction accuracy by improved method increased by more than 4.01%. The average relative error and time of impurity/breakage assessment by proposed method were 7.69% and 1.56s. The proposed method can accurately and rapidly assess impurity/breakage rates for dynamic rice grain flow on combine harvester, and further realize closed-loop control of intelligent harvesting operation.https://ieeexplore.ieee.org/document/10124771/Breakage rategrain flowimpurity raterice harvestvehicle vision |
| spellingShingle | Qian Zhang Jinpeng Hu Lizhang Xu Qibing Cai Xun Yu Peng Liu Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4 IEEE Access Breakage rate grain flow impurity rate rice harvest vehicle vision |
| title | Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4 |
| title_full | Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4 |
| title_fullStr | Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4 |
| title_full_unstemmed | Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4 |
| title_short | Impurity/Breakage Assessment of Vehicle-Mounted Dynamic Rice Grain Flow on Combine Harvester Based on Improved Deeplabv3+ and YOLOv4 |
| title_sort | impurity breakage assessment of vehicle mounted dynamic rice grain flow on combine harvester based on improved deeplabv3 x002b and yolov4 |
| topic | Breakage rate grain flow impurity rate rice harvest vehicle vision |
| url | https://ieeexplore.ieee.org/document/10124771/ |
| work_keys_str_mv | AT qianzhang impuritybreakageassessmentofvehiclemounteddynamicricegrainflowoncombineharvesterbasedonimproveddeeplabv3x002bandyolov4 AT jinpenghu impuritybreakageassessmentofvehiclemounteddynamicricegrainflowoncombineharvesterbasedonimproveddeeplabv3x002bandyolov4 AT lizhangxu impuritybreakageassessmentofvehiclemounteddynamicricegrainflowoncombineharvesterbasedonimproveddeeplabv3x002bandyolov4 AT qibingcai impuritybreakageassessmentofvehiclemounteddynamicricegrainflowoncombineharvesterbasedonimproveddeeplabv3x002bandyolov4 AT xunyu impuritybreakageassessmentofvehiclemounteddynamicricegrainflowoncombineharvesterbasedonimproveddeeplabv3x002bandyolov4 AT pengliu impuritybreakageassessmentofvehiclemounteddynamicricegrainflowoncombineharvesterbasedonimproveddeeplabv3x002bandyolov4 |