Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging

Rapid ripeness assessment of fruit after harvest is important to reduce post-harvest losses by sorting fruit according to the duration until they become ready to eat. However, there has been little research on non-destructive estimation of the ripeness and ripening speed of avocado fruit. Unlike pre...

Full description

Bibliographic Details
Main Authors: Yazad Jamshed Davur, Wiebke Kämper, Kourosh Khoshelham, Stephen J. Trueman, Shahla Hosseini Bai
Format: Article
Language:English
Published: MDPI AG 2023-05-01
Series:Horticulturae
Subjects:
Online Access:https://www.mdpi.com/2311-7524/9/5/599
_version_ 1797599881325445120
author Yazad Jamshed Davur
Wiebke Kämper
Kourosh Khoshelham
Stephen J. Trueman
Shahla Hosseini Bai
author_facet Yazad Jamshed Davur
Wiebke Kämper
Kourosh Khoshelham
Stephen J. Trueman
Shahla Hosseini Bai
author_sort Yazad Jamshed Davur
collection DOAJ
description Rapid ripeness assessment of fruit after harvest is important to reduce post-harvest losses by sorting fruit according to the duration until they become ready to eat. However, there has been little research on non-destructive estimation of the ripeness and ripening speed of avocado fruit. Unlike previous methods, which classify the ripeness of fruit into a few categories (e.g., unripe and ripe) or indirectly estimate ripeness from its firmness, we developed a method using hyperspectral imaging coupled with deep learning regression to directly estimate the duration until ripeness of Hass avocado fruit. A set of 44,096 sub-images of 551 Hass avocado fruit images was used to train, validate, and test a convolutional neural network (CNN) to predict the number of days until ripeness. Training, validation, and test samples were generated as sub-images of Hass fruit images and were used to train a spectral–spatial residual network to estimate the duration to ripeness. We achieved predictions of duration to ripeness with an average error of 1.17 days per fruit on the test set. A series of experiments demonstrated that our deep learning regression approach outperformed classification approaches that rely on dimensionality reduction techniques such as principal component analysis. Our results show the potential for combining hyperspectral imaging with deep learning to estimate the ripeness stage of fruit, which could help to fine-tune avocado fruit sorting and processing.
first_indexed 2024-03-11T03:40:36Z
format Article
id doaj.art-771f5168ca0741e8bd7872a379fb768b
institution Directory Open Access Journal
issn 2311-7524
language English
last_indexed 2024-03-11T03:40:36Z
publishDate 2023-05-01
publisher MDPI AG
record_format Article
series Horticulturae
spelling doaj.art-771f5168ca0741e8bd7872a379fb768b2023-11-18T01:35:08ZengMDPI AGHorticulturae2311-75242023-05-019559910.3390/horticulturae9050599Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral ImagingYazad Jamshed Davur0Wiebke Kämper1Kourosh Khoshelham2Stephen J. Trueman3Shahla Hosseini Bai4School of Computing and Information Systems, The University of Melbourne, Parkville, VIC 3010, AustraliaCentre for Planetary Health and Food Security, School of Environment and Science, Griffith University, Nathan, QLD 4111, AustraliaDepartment of Infrastructure Engineering, The University of Melbourne, Parkville, VIC 3010, AustraliaCentre for Planetary Health and Food Security, School of Environment and Science, Griffith University, Nathan, QLD 4111, AustraliaCentre for Planetary Health and Food Security, School of Environment and Science, Griffith University, Nathan, QLD 4111, AustraliaRapid ripeness assessment of fruit after harvest is important to reduce post-harvest losses by sorting fruit according to the duration until they become ready to eat. However, there has been little research on non-destructive estimation of the ripeness and ripening speed of avocado fruit. Unlike previous methods, which classify the ripeness of fruit into a few categories (e.g., unripe and ripe) or indirectly estimate ripeness from its firmness, we developed a method using hyperspectral imaging coupled with deep learning regression to directly estimate the duration until ripeness of Hass avocado fruit. A set of 44,096 sub-images of 551 Hass avocado fruit images was used to train, validate, and test a convolutional neural network (CNN) to predict the number of days until ripeness. Training, validation, and test samples were generated as sub-images of Hass fruit images and were used to train a spectral–spatial residual network to estimate the duration to ripeness. We achieved predictions of duration to ripeness with an average error of 1.17 days per fruit on the test set. A series of experiments demonstrated that our deep learning regression approach outperformed classification approaches that rely on dimensionality reduction techniques such as principal component analysis. Our results show the potential for combining hyperspectral imaging with deep learning to estimate the ripeness stage of fruit, which could help to fine-tune avocado fruit sorting and processing.https://www.mdpi.com/2311-7524/9/5/599avocadodeep learningHasshyperspectral imaging (HSI)post-harvestripening
spellingShingle Yazad Jamshed Davur
Wiebke Kämper
Kourosh Khoshelham
Stephen J. Trueman
Shahla Hosseini Bai
Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging
Horticulturae
avocado
deep learning
Hass
hyperspectral imaging (HSI)
post-harvest
ripening
title Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging
title_full Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging
title_fullStr Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging
title_full_unstemmed Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging
title_short Estimating the Ripeness of Hass Avocado Fruit Using Deep Learning with Hyperspectral Imaging
title_sort estimating the ripeness of hass avocado fruit using deep learning with hyperspectral imaging
topic avocado
deep learning
Hass
hyperspectral imaging (HSI)
post-harvest
ripening
url https://www.mdpi.com/2311-7524/9/5/599
work_keys_str_mv AT yazadjamsheddavur estimatingtheripenessofhassavocadofruitusingdeeplearningwithhyperspectralimaging
AT wiebkekamper estimatingtheripenessofhassavocadofruitusingdeeplearningwithhyperspectralimaging
AT kouroshkhoshelham estimatingtheripenessofhassavocadofruitusingdeeplearningwithhyperspectralimaging
AT stephenjtrueman estimatingtheripenessofhassavocadofruitusingdeeplearningwithhyperspectralimaging
AT shahlahosseinibai estimatingtheripenessofhassavocadofruitusingdeeplearningwithhyperspectralimaging