Development of effective model for non-destructive detection of defective kiwifruit based on graded lines
The accurate detection of external defects in kiwifruit is an important part of postharvest quality assessment. Previous studies have not considered the problems posed by the actual grading environment. In this study, we designed a novel approach based on improved Yolov5 to achieve real-time and eff...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-08-01
|
| Series: | Frontiers in Plant Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpls.2023.1170221/full |
| _version_ | 1827860310507126784 |
|---|---|
| author | Feiyun Wang Chengxu Lv Lizhong Dong Xilong Li Pengfei Guo Bo Zhao |
| author_facet | Feiyun Wang Chengxu Lv Lizhong Dong Xilong Li Pengfei Guo Bo Zhao |
| author_sort | Feiyun Wang |
| collection | DOAJ |
| description | The accurate detection of external defects in kiwifruit is an important part of postharvest quality assessment. Previous studies have not considered the problems posed by the actual grading environment. In this study, we designed a novel approach based on improved Yolov5 to achieve real-time and efficient non-destructive detection of multiple defect categories in kiwifruit. First, a kiwifruit image acquisition device based on grading lines was developed to enhance the image acquisition. Subsequently, a kiwifruit dataset was constructed based on the external defect characteristics and a new data enhancement method was proposed to augment the kiwifruit samples. Thereafter, the SPD-Conv and DW-Conv modules were combined to improve Yolov5s, with EIOU as the loss calculation function. The results demonstrated that the improved model training loss value was 0.013 lower, the convergence was accelerated, the number of parameters was reduced, and the computational effort was increased. The detection accuracies of the samples in the test set, which included healthy, leaf-rubbing damaged, healed cuts or scarred, and sunburned samples, were 98.8%, 98.7%, 97.6%, and 95.9%, respectively, with an overall detection accuracy of 97.7%. The detection time was 8.0 ms, thereby meeting real-time sorting demands. The average detection accuracy and model size of SSD, Yolov5s, Yolov7, and Yolov5-Ours were compared. When the confidence threshold was 0.5, the detection accuracy of Yolov5-Ours was 10% and 6.4% higher than that of SSD and Yolov5s, respectively. In terms of the model size, Yolov5-Ours was approximately 6.5- and 4-fold smaller than SSD and Yolov7, respectively. Thus, Yolov5-Ours achieved the highest accuracy, adaptability, and robustness for the detection of all kiwifruit categories as well as a small volume and portability. These results can provide technical support for the non-destructive detection and grading of agricultural products in the future. |
| first_indexed | 2024-03-12T13:21:24Z |
| format | Article |
| id | doaj.art-674c45c6da2e4addb2c4d79581777836 |
| institution | Directory Open Access Journal |
| issn | 1664-462X |
| language | English |
| last_indexed | 2024-03-12T13:21:24Z |
| publishDate | 2023-08-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Plant Science |
| spelling | doaj.art-674c45c6da2e4addb2c4d795817778362023-08-25T19:42:28ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2023-08-011410.3389/fpls.2023.11702211170221Development of effective model for non-destructive detection of defective kiwifruit based on graded linesFeiyun WangChengxu LvLizhong DongXilong LiPengfei GuoBo ZhaoThe accurate detection of external defects in kiwifruit is an important part of postharvest quality assessment. Previous studies have not considered the problems posed by the actual grading environment. In this study, we designed a novel approach based on improved Yolov5 to achieve real-time and efficient non-destructive detection of multiple defect categories in kiwifruit. First, a kiwifruit image acquisition device based on grading lines was developed to enhance the image acquisition. Subsequently, a kiwifruit dataset was constructed based on the external defect characteristics and a new data enhancement method was proposed to augment the kiwifruit samples. Thereafter, the SPD-Conv and DW-Conv modules were combined to improve Yolov5s, with EIOU as the loss calculation function. The results demonstrated that the improved model training loss value was 0.013 lower, the convergence was accelerated, the number of parameters was reduced, and the computational effort was increased. The detection accuracies of the samples in the test set, which included healthy, leaf-rubbing damaged, healed cuts or scarred, and sunburned samples, were 98.8%, 98.7%, 97.6%, and 95.9%, respectively, with an overall detection accuracy of 97.7%. The detection time was 8.0 ms, thereby meeting real-time sorting demands. The average detection accuracy and model size of SSD, Yolov5s, Yolov7, and Yolov5-Ours were compared. When the confidence threshold was 0.5, the detection accuracy of Yolov5-Ours was 10% and 6.4% higher than that of SSD and Yolov5s, respectively. In terms of the model size, Yolov5-Ours was approximately 6.5- and 4-fold smaller than SSD and Yolov7, respectively. Thus, Yolov5-Ours achieved the highest accuracy, adaptability, and robustness for the detection of all kiwifruit categories as well as a small volume and portability. These results can provide technical support for the non-destructive detection and grading of agricultural products in the future.https://www.frontiersin.org/articles/10.3389/fpls.2023.1170221/fullkiwifruitgrading lineSPD-ConvDWConvreal timenon-destructive detection |
| spellingShingle | Feiyun Wang Chengxu Lv Lizhong Dong Xilong Li Pengfei Guo Bo Zhao Development of effective model for non-destructive detection of defective kiwifruit based on graded lines Frontiers in Plant Science kiwifruit grading line SPD-Conv DWConv real time non-destructive detection |
| title | Development of effective model for non-destructive detection of defective kiwifruit based on graded lines |
| title_full | Development of effective model for non-destructive detection of defective kiwifruit based on graded lines |
| title_fullStr | Development of effective model for non-destructive detection of defective kiwifruit based on graded lines |
| title_full_unstemmed | Development of effective model for non-destructive detection of defective kiwifruit based on graded lines |
| title_short | Development of effective model for non-destructive detection of defective kiwifruit based on graded lines |
| title_sort | development of effective model for non destructive detection of defective kiwifruit based on graded lines |
| topic | kiwifruit grading line SPD-Conv DWConv real time non-destructive detection |
| url | https://www.frontiersin.org/articles/10.3389/fpls.2023.1170221/full |
| work_keys_str_mv | AT feiyunwang developmentofeffectivemodelfornondestructivedetectionofdefectivekiwifruitbasedongradedlines AT chengxulv developmentofeffectivemodelfornondestructivedetectionofdefectivekiwifruitbasedongradedlines AT lizhongdong developmentofeffectivemodelfornondestructivedetectionofdefectivekiwifruitbasedongradedlines AT xilongli developmentofeffectivemodelfornondestructivedetectionofdefectivekiwifruitbasedongradedlines AT pengfeiguo developmentofeffectivemodelfornondestructivedetectionofdefectivekiwifruitbasedongradedlines AT bozhao developmentofeffectivemodelfornondestructivedetectionofdefectivekiwifruitbasedongradedlines |