Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing
Currently, the detection and localization of tea buds within the unstructured tea plantation environment are greatly challenged due to their small size, significant morphological and growth height variations, and dense spatial distribution. To solve this problem, this study applies an enhanced versi...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-09-01
|
| Series: | Agronomy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2073-4395/13/9/2412 |
| _version_ | 1797581658499579904 |
|---|---|
| author | Lixue Zhu Zhihao Zhang Guichao Lin Pinlan Chen Xiaomin Li Shiang Zhang |
| author_facet | Lixue Zhu Zhihao Zhang Guichao Lin Pinlan Chen Xiaomin Li Shiang Zhang |
| author_sort | Lixue Zhu |
| collection | DOAJ |
| description | Currently, the detection and localization of tea buds within the unstructured tea plantation environment are greatly challenged due to their small size, significant morphological and growth height variations, and dense spatial distribution. To solve this problem, this study applies an enhanced version of the YOLOv5 algorithm for tea bud detection in a wide field of view. Also, small-size tea bud localization based on 3D point cloud technology is used to facilitate the detection of tea buds and the identification of picking points for a renowned tea-picking robot. To enhance the YOLOv5 network, the Efficient Channel Attention Network (ECANet) module and Bi-directional Feature Pyramid Network (BiFPN) are incorporated. After acquiring the 3D point cloud for the region of interest in the detection results, the 3D point cloud of the tea bud is extracted using the DBSCAN clustering algorithm to determine the 3D coordinates of the tea bud picking points. Principal component analysis is then utilized to fit the minimum outer cuboid to the 3D point cloud of tea buds, thereby solving for the 3D coordinates of the picking points. To evaluate the effectiveness of the proposed algorithm, an experiment is conducted using a collected tea image test set, resulting in a detection precision of 94.4% and a recall rate of 90.38%. Additionally, a field experiment is conducted in a tea experimental field to assess localization accuracy, with mean absolute errors of 3.159 mm, 6.918 mm, and 7.185 mm observed in the x, y, and z directions, respectively. The average time consumed for detection and localization is 0.129 s, which fulfills the requirements of well-known tea plucking robots in outdoor tea gardens for quick identification and exact placement of small-sized tea shoots with a wide field of view. |
| first_indexed | 2024-03-10T23:07:38Z |
| format | Article |
| id | doaj.art-90f193b2ed814c84b793c251157c181c |
| institution | Directory Open Access Journal |
| issn | 2073-4395 |
| language | English |
| last_indexed | 2024-03-10T23:07:38Z |
| publishDate | 2023-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Agronomy |
| spelling | doaj.art-90f193b2ed814c84b793c251157c181c2023-11-19T09:11:56ZengMDPI AGAgronomy2073-43952023-09-01139241210.3390/agronomy13092412Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud ProcessingLixue Zhu0Zhihao Zhang1Guichao Lin2Pinlan Chen3Xiaomin Li4Shiang Zhang5School of Mechanical and Electrical Engineering, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, ChinaSchool of Mechanical and Electrical Engineering, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, ChinaSchool of Mechanical and Electrical Engineering, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, ChinaSchool of Mechanical and Electrical Engineering, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, ChinaSchool of Mechanical and Electrical Engineering, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, ChinaCollege of Innovation and Entrepreneurship, Zhongkai University of Agriculture and Engineering, Guangzhou 510225, ChinaCurrently, the detection and localization of tea buds within the unstructured tea plantation environment are greatly challenged due to their small size, significant morphological and growth height variations, and dense spatial distribution. To solve this problem, this study applies an enhanced version of the YOLOv5 algorithm for tea bud detection in a wide field of view. Also, small-size tea bud localization based on 3D point cloud technology is used to facilitate the detection of tea buds and the identification of picking points for a renowned tea-picking robot. To enhance the YOLOv5 network, the Efficient Channel Attention Network (ECANet) module and Bi-directional Feature Pyramid Network (BiFPN) are incorporated. After acquiring the 3D point cloud for the region of interest in the detection results, the 3D point cloud of the tea bud is extracted using the DBSCAN clustering algorithm to determine the 3D coordinates of the tea bud picking points. Principal component analysis is then utilized to fit the minimum outer cuboid to the 3D point cloud of tea buds, thereby solving for the 3D coordinates of the picking points. To evaluate the effectiveness of the proposed algorithm, an experiment is conducted using a collected tea image test set, resulting in a detection precision of 94.4% and a recall rate of 90.38%. Additionally, a field experiment is conducted in a tea experimental field to assess localization accuracy, with mean absolute errors of 3.159 mm, 6.918 mm, and 7.185 mm observed in the x, y, and z directions, respectively. The average time consumed for detection and localization is 0.129 s, which fulfills the requirements of well-known tea plucking robots in outdoor tea gardens for quick identification and exact placement of small-sized tea shoots with a wide field of view.https://www.mdpi.com/2073-4395/13/9/2412the famous teatea budslocating and detectingYOLOv5point cloud |
| spellingShingle | Lixue Zhu Zhihao Zhang Guichao Lin Pinlan Chen Xiaomin Li Shiang Zhang Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing Agronomy the famous tea tea buds locating and detecting YOLOv5 point cloud |
| title | Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing |
| title_full | Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing |
| title_fullStr | Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing |
| title_full_unstemmed | Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing |
| title_short | Detection and Localization of Tea Bud Based on Improved YOLOv5s and 3D Point Cloud Processing |
| title_sort | detection and localization of tea bud based on improved yolov5s and 3d point cloud processing |
| topic | the famous tea tea buds locating and detecting YOLOv5 point cloud |
| url | https://www.mdpi.com/2073-4395/13/9/2412 |
| work_keys_str_mv | AT lixuezhu detectionandlocalizationofteabudbasedonimprovedyolov5sand3dpointcloudprocessing AT zhihaozhang detectionandlocalizationofteabudbasedonimprovedyolov5sand3dpointcloudprocessing AT guichaolin detectionandlocalizationofteabudbasedonimprovedyolov5sand3dpointcloudprocessing AT pinlanchen detectionandlocalizationofteabudbasedonimprovedyolov5sand3dpointcloudprocessing AT xiaominli detectionandlocalizationofteabudbasedonimprovedyolov5sand3dpointcloudprocessing AT shiangzhang detectionandlocalizationofteabudbasedonimprovedyolov5sand3dpointcloudprocessing |