Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning

In modern agricultural practices, advanced machine learning techniques play a pivotal role in optimizing yields and management. A significant challenge in orchard management is detecting apples on trees, which is essential for effective harvest planning and yield estimation. The YOLO series, especia...

Full description

Bibliographic Details
Main Authors: Jiayi Zhao, Aldo Lipani, Calogero Schillaci
Format: Article
Language:English
Published: Elsevier 2024-08-01
Series:Smart Agricultural Technology
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2772375524000418
_version_ 1827149160067891200
author Jiayi Zhao
Aldo Lipani
Calogero Schillaci
author_facet Jiayi Zhao
Aldo Lipani
Calogero Schillaci
author_sort Jiayi Zhao
collection DOAJ
description In modern agricultural practices, advanced machine learning techniques play a pivotal role in optimizing yields and management. A significant challenge in orchard management is detecting apples on trees, which is essential for effective harvest planning and yield estimation. The YOLO series, especially the YOLOv8 model, stands out as a state-of-the-art solution for object detection, but its potential in orchards remains untapped. Addressing this, our study evaluates YOLOv8’s capability in orchard apple detection, aiming to set a benchmark. By employing image augmentation techniques like exposure, rotation, mosaic, and cutout, we lifted the model's performance to a state-of-the-art level. We further integrated multi-task learning, enhancing tree apple detection by also identifying apples on the ground. This approach resulted in a model with robust accuracy across evaluation metrics. Our results underscore that the YOLOv8 model achieves a leading standard in orchard apple detection. When trained for both tree and fallen apple detection, it outperformed the one when trained exclusively for the former. Recognizing fallen apples not only reduces waste but could also indicate pest activity, influencing strategic orchard decisions and potentially boosting economic returns. Merging cutting-edge tech with agricultural needs, our research showcases the promise of multi-task learning in fruit detection with deep learning.
first_indexed 2024-04-24T11:20:31Z
format Article
id doaj.art-b9125e644c554211ba40722cb83e94eb
institution Directory Open Access Journal
issn 2772-3755
language English
last_indexed 2025-03-20T21:13:46Z
publishDate 2024-08-01
publisher Elsevier
record_format Article
series Smart Agricultural Technology
spelling doaj.art-b9125e644c554211ba40722cb83e94eb2024-08-13T06:26:37ZengElsevierSmart Agricultural Technology2772-37552024-08-018100436Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learningJiayi Zhao0Aldo Lipani1Calogero Schillaci2University College London, London, United KingdomUniversity College London, London, United KingdomEuropean Commission, Joint Research Centre, Ispra, Italy; Corresponding author.In modern agricultural practices, advanced machine learning techniques play a pivotal role in optimizing yields and management. A significant challenge in orchard management is detecting apples on trees, which is essential for effective harvest planning and yield estimation. The YOLO series, especially the YOLOv8 model, stands out as a state-of-the-art solution for object detection, but its potential in orchards remains untapped. Addressing this, our study evaluates YOLOv8’s capability in orchard apple detection, aiming to set a benchmark. By employing image augmentation techniques like exposure, rotation, mosaic, and cutout, we lifted the model's performance to a state-of-the-art level. We further integrated multi-task learning, enhancing tree apple detection by also identifying apples on the ground. This approach resulted in a model with robust accuracy across evaluation metrics. Our results underscore that the YOLOv8 model achieves a leading standard in orchard apple detection. When trained for both tree and fallen apple detection, it outperformed the one when trained exclusively for the former. Recognizing fallen apples not only reduces waste but could also indicate pest activity, influencing strategic orchard decisions and potentially boosting economic returns. Merging cutting-edge tech with agricultural needs, our research showcases the promise of multi-task learning in fruit detection with deep learning.http://www.sciencedirect.com/science/article/pii/S2772375524000418Automatic agricultureDeep learningDetection of orchard appleYOLOv8 modelData augmentation techniques
spellingShingle Jiayi Zhao
Aldo Lipani
Calogero Schillaci
Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning
Smart Agricultural Technology
Automatic agriculture
Deep learning
Detection of orchard apple
YOLOv8 model
Data augmentation techniques
title Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning
title_full Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning
title_fullStr Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning
title_full_unstemmed Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning
title_short Fallen apple detection as an auxiliary task: Boosting robotic apple detection performance through multi-task learning
title_sort fallen apple detection as an auxiliary task boosting robotic apple detection performance through multi task learning
topic Automatic agriculture
Deep learning
Detection of orchard apple
YOLOv8 model
Data augmentation techniques
url http://www.sciencedirect.com/science/article/pii/S2772375524000418
work_keys_str_mv AT jiayizhao fallenappledetectionasanauxiliarytaskboostingroboticappledetectionperformancethroughmultitasklearning
AT aldolipani fallenappledetectionasanauxiliarytaskboostingroboticappledetectionperformancethroughmultitasklearning
AT calogeroschillaci fallenappledetectionasanauxiliarytaskboostingroboticappledetectionperformancethroughmultitasklearning