Deep Learning based flower detection and counting in highly populated images: A peach grove case study

Farmers and producers need to estimate crop yield in order to plan and allocate human and economic resources during the harvesting season. For many crops, such as peach groves, the number of fruits is correlated with the number of flowers produced by each tree. Therefore, estimating the number of fl...

Full description

Bibliographic Details
Main Authors: Juan Sebastian Estrada, Juan Pablo Vasconez, Longsheng Fu, Fernando Auat Cheein
Format: Article
Language:English
Published: Elsevier 2024-03-01
Series:Journal of Agriculture and Food Research
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666154323004374
_version_ 1797271339248123904
author Juan Sebastian Estrada
Juan Pablo Vasconez
Longsheng Fu
Fernando Auat Cheein
author_facet Juan Sebastian Estrada
Juan Pablo Vasconez
Longsheng Fu
Fernando Auat Cheein
author_sort Juan Sebastian Estrada
collection DOAJ
description Farmers and producers need to estimate crop yield in order to plan and allocate human and economic resources during the harvesting season. For many crops, such as peach groves, the number of fruits is correlated with the number of flowers produced by each tree. Therefore, estimating the number of flowers in peach groves can serve as a good indicator of crop yield, disregarding climate hazards. However, in peach groves, tree images present several challenges, including a high number of flowers, interference from distant trees, and occlusion between elements. These issues pose a difficult task for computer vision and machine learning techniques. In this study, we propose the utilization of state-of-the-art deep learning techniques for image detection purposes; namely the YOLO architectures on its versions 5, 7, and 8 and their different size models (n, s, m, l, x); as well as predicting object density using multi-column in densely populated images, using a multi-column deep neural network. The methodology was tested on a new dataset comprising 600 images of peach trees during the blooming season, in the region of Catalonia, Spain. Out of these, 400 images were used to train the model, while 100 were allocated for testing and another 100 for validation. The counting results were evaluated using metrics such as Mean Squared Error (MSE), Mean Absolute Error (MAE), and percentage error (%Err). For the detection algorithms, metrics such as accuracy, precision, recall, and mean average precision were utilized, alongside metrics for evaluating the counting process.The experiments demonstrated that predicting the density map yielded better results in the counting process, achieving an MAE of 39.13, RMSE of 69.69, and a percentage error of 9.98. The detection algorithm that exhibited superior performance was YOLOv7x, with metrics of MAE 152.7, RMSE 212.9, and a percentage error of 29.7 %. These results indicate that, for counting purposes, predicting the density map produced better overall outcomes.
first_indexed 2024-03-07T14:00:17Z
format Article
id doaj.art-9f2a35e3db4e4f92a26c6dc590916be0
institution Directory Open Access Journal
issn 2666-1543
language English
last_indexed 2024-03-07T14:00:17Z
publishDate 2024-03-01
publisher Elsevier
record_format Article
series Journal of Agriculture and Food Research
spelling doaj.art-9f2a35e3db4e4f92a26c6dc590916be02024-03-07T05:29:32ZengElsevierJournal of Agriculture and Food Research2666-15432024-03-0115100930Deep Learning based flower detection and counting in highly populated images: A peach grove case studyJuan Sebastian Estrada0Juan Pablo Vasconez1Longsheng Fu2Fernando Auat Cheein3Department of Electronic Engineering, Universidad Técnica Federico Santa María, Av. España 1680, Valparaíso, ChileFaculty of Engineering, Universidad Andrés Bello, Bellavista, 0121, Santiago, ChileNorthwest A&F University Shenzhen Research Institute, Shenzhen, Guangdong, 518000, ChinaDepartment of Electronic Engineering, Universidad Técnica Federico Santa María, Av. España 1680, Valparaíso, Chile; National Robotarium, School of Physical Sciences and Engineering, Heriot-Watt University, Edinburgh, Scotland, UK; Corresponding author.Farmers and producers need to estimate crop yield in order to plan and allocate human and economic resources during the harvesting season. For many crops, such as peach groves, the number of fruits is correlated with the number of flowers produced by each tree. Therefore, estimating the number of flowers in peach groves can serve as a good indicator of crop yield, disregarding climate hazards. However, in peach groves, tree images present several challenges, including a high number of flowers, interference from distant trees, and occlusion between elements. These issues pose a difficult task for computer vision and machine learning techniques. In this study, we propose the utilization of state-of-the-art deep learning techniques for image detection purposes; namely the YOLO architectures on its versions 5, 7, and 8 and their different size models (n, s, m, l, x); as well as predicting object density using multi-column in densely populated images, using a multi-column deep neural network. The methodology was tested on a new dataset comprising 600 images of peach trees during the blooming season, in the region of Catalonia, Spain. Out of these, 400 images were used to train the model, while 100 were allocated for testing and another 100 for validation. The counting results were evaluated using metrics such as Mean Squared Error (MSE), Mean Absolute Error (MAE), and percentage error (%Err). For the detection algorithms, metrics such as accuracy, precision, recall, and mean average precision were utilized, alongside metrics for evaluating the counting process.The experiments demonstrated that predicting the density map yielded better results in the counting process, achieving an MAE of 39.13, RMSE of 69.69, and a percentage error of 9.98. The detection algorithm that exhibited superior performance was YOLOv7x, with metrics of MAE 152.7, RMSE 212.9, and a percentage error of 29.7 %. These results indicate that, for counting purposes, predicting the density map produced better overall outcomes.http://www.sciencedirect.com/science/article/pii/S2666154323004374High-density imagesPeach flower countingDeep learningDensity mapsYOLO detection
spellingShingle Juan Sebastian Estrada
Juan Pablo Vasconez
Longsheng Fu
Fernando Auat Cheein
Deep Learning based flower detection and counting in highly populated images: A peach grove case study
Journal of Agriculture and Food Research
High-density images
Peach flower counting
Deep learning
Density maps
YOLO detection
title Deep Learning based flower detection and counting in highly populated images: A peach grove case study
title_full Deep Learning based flower detection and counting in highly populated images: A peach grove case study
title_fullStr Deep Learning based flower detection and counting in highly populated images: A peach grove case study
title_full_unstemmed Deep Learning based flower detection and counting in highly populated images: A peach grove case study
title_short Deep Learning based flower detection and counting in highly populated images: A peach grove case study
title_sort deep learning based flower detection and counting in highly populated images a peach grove case study
topic High-density images
Peach flower counting
Deep learning
Density maps
YOLO detection
url http://www.sciencedirect.com/science/article/pii/S2666154323004374
work_keys_str_mv AT juansebastianestrada deeplearningbasedflowerdetectionandcountinginhighlypopulatedimagesapeachgrovecasestudy
AT juanpablovasconez deeplearningbasedflowerdetectionandcountinginhighlypopulatedimagesapeachgrovecasestudy
AT longshengfu deeplearningbasedflowerdetectionandcountinginhighlypopulatedimagesapeachgrovecasestudy
AT fernandoauatcheein deeplearningbasedflowerdetectionandcountinginhighlypopulatedimagesapeachgrovecasestudy