Detection of Anomalous Grapevine Berries Using Variational Autoencoders

Grapevine is one of the economically most important quality crops. The monitoring of the plant performance during the growth period is, therefore, important to ensure a high quality end-product. This includes the observation, detection, and respective reduction of unhealthy berries (physically damag...

Full description

Bibliographic Details
Main Authors: Miro Miranda, Laura Zabawa, Anna Kicherer, Laurenz Strothmann, Uwe Rascher, Ribana Roscher
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-06-01
Series:Frontiers in Plant Science
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpls.2022.729097/full
_version_ 1818208620221825024
author Miro Miranda
Laura Zabawa
Anna Kicherer
Laurenz Strothmann
Uwe Rascher
Ribana Roscher
Ribana Roscher
author_facet Miro Miranda
Laura Zabawa
Anna Kicherer
Laurenz Strothmann
Uwe Rascher
Ribana Roscher
Ribana Roscher
author_sort Miro Miranda
collection DOAJ
description Grapevine is one of the economically most important quality crops. The monitoring of the plant performance during the growth period is, therefore, important to ensure a high quality end-product. This includes the observation, detection, and respective reduction of unhealthy berries (physically damaged, or diseased). At harvest, it is not necessary to know the exact cause of the damage, but rather if the damage is apparent or not. Since a manual screening and selection before harvest is time-consuming and expensive, we propose an automatic, image-based machine learning approach, which can lead observers directly to anomalous areas without the need to monitor every plant manually. Specifically, we train a fully convolutional variational autoencoder with a feature perceptual loss on images with healthy berries only and consider image areas with deviations from this model as damaged berries. We use heatmaps which visualize the results of the trained neural network and, therefore, support the decision making for farmers. We compare our method against a convolutional autoencoder that was successfully applied to a similar task and show that our approach outperforms it.
first_indexed 2024-12-12T04:47:42Z
format Article
id doaj.art-65bda24057f5426ba5c4651c8b5a7912
institution Directory Open Access Journal
issn 1664-462X
language English
last_indexed 2024-12-12T04:47:42Z
publishDate 2022-06-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Plant Science
spelling doaj.art-65bda24057f5426ba5c4651c8b5a79122022-12-22T00:37:34ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2022-06-011310.3389/fpls.2022.729097729097Detection of Anomalous Grapevine Berries Using Variational AutoencodersMiro Miranda0Laura Zabawa1Anna Kicherer2Laurenz Strothmann3Uwe Rascher4Ribana Roscher5Ribana Roscher6Remote Sensing Group, Institute of Geodesy and Geoinformation, University of Bonn, Bonn, GermanyInstitute of Geodesy and Geoinformation, Professorship of Geodesy, University of Bonn, Bonn, GermanyJulius Kühn-Institut, Institute for Grapevine Breeding Geilweilerhof, Geilweilerhof, GermanyInstitute of Bio- and Geosciences IBG-2, Plant Sciences, Forschungszentrum Jülich, Jülich, GermanyInstitute of Bio- and Geosciences IBG-2, Plant Sciences, Forschungszentrum Jülich, Jülich, GermanyRemote Sensing Group, Institute of Geodesy and Geoinformation, University of Bonn, Bonn, GermanyInternational AI Future Lab, Technical University of Munich, Munich, GermanyGrapevine is one of the economically most important quality crops. The monitoring of the plant performance during the growth period is, therefore, important to ensure a high quality end-product. This includes the observation, detection, and respective reduction of unhealthy berries (physically damaged, or diseased). At harvest, it is not necessary to know the exact cause of the damage, but rather if the damage is apparent or not. Since a manual screening and selection before harvest is time-consuming and expensive, we propose an automatic, image-based machine learning approach, which can lead observers directly to anomalous areas without the need to monitor every plant manually. Specifically, we train a fully convolutional variational autoencoder with a feature perceptual loss on images with healthy berries only and consider image areas with deviations from this model as damaged berries. We use heatmaps which visualize the results of the trained neural network and, therefore, support the decision making for farmers. We compare our method against a convolutional autoencoder that was successfully applied to a similar task and show that our approach outperforms it.https://www.frontiersin.org/articles/10.3389/fpls.2022.729097/fullautoencoderdeep learninganomaly detectionviticulturedisease detection
spellingShingle Miro Miranda
Laura Zabawa
Anna Kicherer
Laurenz Strothmann
Uwe Rascher
Ribana Roscher
Ribana Roscher
Detection of Anomalous Grapevine Berries Using Variational Autoencoders
Frontiers in Plant Science
autoencoder
deep learning
anomaly detection
viticulture
disease detection
title Detection of Anomalous Grapevine Berries Using Variational Autoencoders
title_full Detection of Anomalous Grapevine Berries Using Variational Autoencoders
title_fullStr Detection of Anomalous Grapevine Berries Using Variational Autoencoders
title_full_unstemmed Detection of Anomalous Grapevine Berries Using Variational Autoencoders
title_short Detection of Anomalous Grapevine Berries Using Variational Autoencoders
title_sort detection of anomalous grapevine berries using variational autoencoders
topic autoencoder
deep learning
anomaly detection
viticulture
disease detection
url https://www.frontiersin.org/articles/10.3389/fpls.2022.729097/full
work_keys_str_mv AT miromiranda detectionofanomalousgrapevineberriesusingvariationalautoencoders
AT laurazabawa detectionofanomalousgrapevineberriesusingvariationalautoencoders
AT annakicherer detectionofanomalousgrapevineberriesusingvariationalautoencoders
AT laurenzstrothmann detectionofanomalousgrapevineberriesusingvariationalautoencoders
AT uwerascher detectionofanomalousgrapevineberriesusingvariationalautoencoders
AT ribanaroscher detectionofanomalousgrapevineberriesusingvariationalautoencoders
AT ribanaroscher detectionofanomalousgrapevineberriesusingvariationalautoencoders