Research on multi-cluster green persimmon detection method based on improved Faster RCNN

To address the problem of accurate recognition and localization of multiple clusters of green persimmons with similar color to the background under natural environment, this study proposes a multi-cluster green persimmon identification method based on improved Faster RCNN was proposed by using the s...

Full description

Bibliographic Details
Main Authors: Yangyang Liu, Huimin Ren, Zhi Zhang, Fansheng Men, Pengyang Zhang, Delin Wu, Ruizhuo Feng
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-06-01
Series:Frontiers in Plant Science
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpls.2023.1177114/full
_version_ 1797810518595993600
author Yangyang Liu
Huimin Ren
Zhi Zhang
Fansheng Men
Pengyang Zhang
Delin Wu
Ruizhuo Feng
author_facet Yangyang Liu
Huimin Ren
Zhi Zhang
Fansheng Men
Pengyang Zhang
Delin Wu
Ruizhuo Feng
author_sort Yangyang Liu
collection DOAJ
description To address the problem of accurate recognition and localization of multiple clusters of green persimmons with similar color to the background under natural environment, this study proposes a multi-cluster green persimmon identification method based on improved Faster RCNN was proposed by using the self-built green persimmon dataset. The feature extractor DetNet is used as the backbone feature extraction network, and the model detection attention is focused on the target object itself by adding the weighted ECA channel attention mechanism to the three effective feature layers in the backbone, and the detection accuracy of the algorithm is improved. By maximizing the pooling of the lower layer features with the added attention mechanism, the high and low dimensions and magnitudes are made the same. The processed feature layers are combined with multi-scale features using a serial layer-hopping connection structure to enhance the robustness of feature information, effectively copes with the problem of target detection of objects with obscured near scenery in complex environments and accelerates the detection speed through feature complementarity between different feature layers. In this study, the K-means clustering algorithm is used to group and anchor the bounding boxes so that they converge to the actual bounding boxes, The average mean accuracy (mAP) of the improved Faster RCNN model reaches 98.4%, which was 11.8% higher than that of traditional Faster RCNN model, which also increases the accuracy of object detection during regression prediction. and the average detection time of a single image is improved by 0.54s. The algorithm is significantly improved in terms of accuracy and speed, which provides a basis for green fruit growth state monitoring and intelligent yield estimation in real scenarios.
first_indexed 2024-03-13T07:08:59Z
format Article
id doaj.art-c1b6f8a4bd4d47878714977853559c99
institution Directory Open Access Journal
issn 1664-462X
language English
last_indexed 2024-03-13T07:08:59Z
publishDate 2023-06-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Plant Science
spelling doaj.art-c1b6f8a4bd4d47878714977853559c992023-06-06T04:50:53ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2023-06-011410.3389/fpls.2023.11771141177114Research on multi-cluster green persimmon detection method based on improved Faster RCNNYangyang Liu0Huimin Ren1Zhi Zhang2Fansheng Men3Pengyang Zhang4Delin Wu5Ruizhuo Feng6School of Engineering, Anhui Agricultural University, Hefei, Anhui, ChinaSchool of Engineering, Anhui Agricultural University, Hefei, Anhui, ChinaSchool of Engineering, Anhui Agricultural University, Hefei, Anhui, ChinaSchool of Mechanical Engineering, Yangzhou University, Yangzhou, ChinaSchool of Engineering, Anhui Agricultural University, Hefei, Anhui, ChinaSchool of Engineering, Anhui Agricultural University, Hefei, Anhui, ChinaSchool of Engineering, Anhui Agricultural University, Hefei, Anhui, ChinaTo address the problem of accurate recognition and localization of multiple clusters of green persimmons with similar color to the background under natural environment, this study proposes a multi-cluster green persimmon identification method based on improved Faster RCNN was proposed by using the self-built green persimmon dataset. The feature extractor DetNet is used as the backbone feature extraction network, and the model detection attention is focused on the target object itself by adding the weighted ECA channel attention mechanism to the three effective feature layers in the backbone, and the detection accuracy of the algorithm is improved. By maximizing the pooling of the lower layer features with the added attention mechanism, the high and low dimensions and magnitudes are made the same. The processed feature layers are combined with multi-scale features using a serial layer-hopping connection structure to enhance the robustness of feature information, effectively copes with the problem of target detection of objects with obscured near scenery in complex environments and accelerates the detection speed through feature complementarity between different feature layers. In this study, the K-means clustering algorithm is used to group and anchor the bounding boxes so that they converge to the actual bounding boxes, The average mean accuracy (mAP) of the improved Faster RCNN model reaches 98.4%, which was 11.8% higher than that of traditional Faster RCNN model, which also increases the accuracy of object detection during regression prediction. and the average detection time of a single image is improved by 0.54s. The algorithm is significantly improved in terms of accuracy and speed, which provides a basis for green fruit growth state monitoring and intelligent yield estimation in real scenarios.https://www.frontiersin.org/articles/10.3389/fpls.2023.1177114/fullmulti-cluster green persimmon recognitionocclusion imagesDetNetattention mechanismmulti-scale feature fusion
spellingShingle Yangyang Liu
Huimin Ren
Zhi Zhang
Fansheng Men
Pengyang Zhang
Delin Wu
Ruizhuo Feng
Research on multi-cluster green persimmon detection method based on improved Faster RCNN
Frontiers in Plant Science
multi-cluster green persimmon recognition
occlusion images
DetNet
attention mechanism
multi-scale feature fusion
title Research on multi-cluster green persimmon detection method based on improved Faster RCNN
title_full Research on multi-cluster green persimmon detection method based on improved Faster RCNN
title_fullStr Research on multi-cluster green persimmon detection method based on improved Faster RCNN
title_full_unstemmed Research on multi-cluster green persimmon detection method based on improved Faster RCNN
title_short Research on multi-cluster green persimmon detection method based on improved Faster RCNN
title_sort research on multi cluster green persimmon detection method based on improved faster rcnn
topic multi-cluster green persimmon recognition
occlusion images
DetNet
attention mechanism
multi-scale feature fusion
url https://www.frontiersin.org/articles/10.3389/fpls.2023.1177114/full
work_keys_str_mv AT yangyangliu researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn
AT huiminren researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn
AT zhizhang researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn
AT fanshengmen researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn
AT pengyangzhang researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn
AT delinwu researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn
AT ruizhuofeng researchonmulticlustergreenpersimmondetectionmethodbasedonimprovedfasterrcnn