Explainable deep learning in plant phenotyping

The increasing human population and variable weather conditions, due to climate change, pose a threat to the world's food security. To improve global food security, we need to provide breeders with tools to develop crop cultivars that are more resilient to extreme weather conditions and provide...

Full description

Bibliographic Details
Main Authors: Sakib Mostafa, Debajyoti Mondal, Karim Panjvani, Leon Kochian, Ian Stavness
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-09-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2023.1203546/full
_version_ 1797681065889890304
author Sakib Mostafa
Debajyoti Mondal
Karim Panjvani
Leon Kochian
Ian Stavness
author_facet Sakib Mostafa
Debajyoti Mondal
Karim Panjvani
Leon Kochian
Ian Stavness
author_sort Sakib Mostafa
collection DOAJ
description The increasing human population and variable weather conditions, due to climate change, pose a threat to the world's food security. To improve global food security, we need to provide breeders with tools to develop crop cultivars that are more resilient to extreme weather conditions and provide growers with tools to more effectively manage biotic and abiotic stresses in their crops. Plant phenotyping, the measurement of a plant's structural and functional characteristics, has the potential to inform, improve and accelerate both breeders' selections and growers' management decisions. To improve the speed, reliability and scale of plant phenotyping procedures, many researchers have adopted deep learning methods to estimate phenotypic information from images of plants and crops. Despite the successful results of these image-based phenotyping studies, the representations learned by deep learning models remain difficult to interpret, understand, and explain. For this reason, deep learning models are still considered to be black boxes. Explainable AI (XAI) is a promising approach for opening the deep learning model's black box and providing plant scientists with image-based phenotypic information that is interpretable and trustworthy. Although various fields of study have adopted XAI to advance their understanding of deep learning models, it has yet to be well-studied in the context of plant phenotyping research. In this review article, we reviewed existing XAI studies in plant shoot phenotyping, as well as related domains, to help plant researchers understand the benefits of XAI and make it easier for them to integrate XAI into their future studies. An elucidation of the representations within a deep learning model can help researchers explain the model's decisions, relate the features detected by the model to the underlying plant physiology, and enhance the trustworthiness of image-based phenotypic information used in food production systems.
first_indexed 2024-03-11T23:39:29Z
format Article
id doaj.art-fc22a06d09b849e6bced304da0bcb016
institution Directory Open Access Journal
issn 2624-8212
language English
last_indexed 2024-03-11T23:39:29Z
publishDate 2023-09-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Artificial Intelligence
spelling doaj.art-fc22a06d09b849e6bced304da0bcb0162023-09-19T16:22:21ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122023-09-01610.3389/frai.2023.12035461203546Explainable deep learning in plant phenotypingSakib Mostafa0Debajyoti Mondal1Karim Panjvani2Leon Kochian3Ian Stavness4Department of Computer Science, University of Saskatchewan, Saskatoon, SK, CanadaDepartment of Computer Science, University of Saskatchewan, Saskatoon, SK, CanadaGlobal Institute for Food Security, University of Saskatchewan, Saskatoon, SK, CanadaGlobal Institute for Food Security, University of Saskatchewan, Saskatoon, SK, CanadaDepartment of Computer Science, University of Saskatchewan, Saskatoon, SK, CanadaThe increasing human population and variable weather conditions, due to climate change, pose a threat to the world's food security. To improve global food security, we need to provide breeders with tools to develop crop cultivars that are more resilient to extreme weather conditions and provide growers with tools to more effectively manage biotic and abiotic stresses in their crops. Plant phenotyping, the measurement of a plant's structural and functional characteristics, has the potential to inform, improve and accelerate both breeders' selections and growers' management decisions. To improve the speed, reliability and scale of plant phenotyping procedures, many researchers have adopted deep learning methods to estimate phenotypic information from images of plants and crops. Despite the successful results of these image-based phenotyping studies, the representations learned by deep learning models remain difficult to interpret, understand, and explain. For this reason, deep learning models are still considered to be black boxes. Explainable AI (XAI) is a promising approach for opening the deep learning model's black box and providing plant scientists with image-based phenotypic information that is interpretable and trustworthy. Although various fields of study have adopted XAI to advance their understanding of deep learning models, it has yet to be well-studied in the context of plant phenotyping research. In this review article, we reviewed existing XAI studies in plant shoot phenotyping, as well as related domains, to help plant researchers understand the benefits of XAI and make it easier for them to integrate XAI into their future studies. An elucidation of the representations within a deep learning model can help researchers explain the model's decisions, relate the features detected by the model to the underlying plant physiology, and enhance the trustworthiness of image-based phenotypic information used in food production systems.https://www.frontiersin.org/articles/10.3389/frai.2023.1203546/fullexplainable AIdeep learningplant phenotypingdata biasagriculture
spellingShingle Sakib Mostafa
Debajyoti Mondal
Karim Panjvani
Leon Kochian
Ian Stavness
Explainable deep learning in plant phenotyping
Frontiers in Artificial Intelligence
explainable AI
deep learning
plant phenotyping
data bias
agriculture
title Explainable deep learning in plant phenotyping
title_full Explainable deep learning in plant phenotyping
title_fullStr Explainable deep learning in plant phenotyping
title_full_unstemmed Explainable deep learning in plant phenotyping
title_short Explainable deep learning in plant phenotyping
title_sort explainable deep learning in plant phenotyping
topic explainable AI
deep learning
plant phenotyping
data bias
agriculture
url https://www.frontiersin.org/articles/10.3389/frai.2023.1203546/full
work_keys_str_mv AT sakibmostafa explainabledeeplearninginplantphenotyping
AT debajyotimondal explainabledeeplearninginplantphenotyping
AT karimpanjvani explainabledeeplearninginplantphenotyping
AT leonkochian explainabledeeplearninginplantphenotyping
AT ianstavness explainabledeeplearninginplantphenotyping