A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning

Using multispectral sensors attached to unmanned aerial vehicles (UAVs) can assist in the collection of morphological and physiological information from several crops. This approach, also known as high-throughput phenotyping, combined with data processing by machine learning (ML) algorithms, can pro...

Full description

Bibliographic Details
Main Authors: Dthenifer Cordeiro Santana, Gustavo de Faria Theodoro, Ricardo Gava, João Lucas Gouveia de Oliveira, Larissa Pereira Ribeiro Teodoro, Izabela Cristina de Oliveira, Fábio Henrique Rojo Baio, Carlos Antonio da Silva Junior, Job Teixeira de Oliveira, Paulo Eduardo Teodoro
Format: Article
Language:English
Published: MDPI AG 2024-01-01
Series:Algorithms
Subjects:
Online Access:https://www.mdpi.com/1999-4893/17/1/23
_version_ 1797340214057762816
author Dthenifer Cordeiro Santana
Gustavo de Faria Theodoro
Ricardo Gava
João Lucas Gouveia de Oliveira
Larissa Pereira Ribeiro Teodoro
Izabela Cristina de Oliveira
Fábio Henrique Rojo Baio
Carlos Antonio da Silva Junior
Job Teixeira de Oliveira
Paulo Eduardo Teodoro
author_facet Dthenifer Cordeiro Santana
Gustavo de Faria Theodoro
Ricardo Gava
João Lucas Gouveia de Oliveira
Larissa Pereira Ribeiro Teodoro
Izabela Cristina de Oliveira
Fábio Henrique Rojo Baio
Carlos Antonio da Silva Junior
Job Teixeira de Oliveira
Paulo Eduardo Teodoro
author_sort Dthenifer Cordeiro Santana
collection DOAJ
description Using multispectral sensors attached to unmanned aerial vehicles (UAVs) can assist in the collection of morphological and physiological information from several crops. This approach, also known as high-throughput phenotyping, combined with data processing by machine learning (ML) algorithms, can provide fast, accurate, and large-scale discrimination of genotypes in the field, which is crucial for improving the efficiency of breeding programs. Despite their importance, studies aimed at accurately classifying sorghum hybrids using spectral variables as input sets in ML models are still scarce in the literature. Against this backdrop, this study aimed: (I) to discriminate sorghum hybrids based on canopy reflectance in different spectral bands (SB) and vegetation indices (VIs); (II) to evaluate the performance of ML algorithms in classifying sorghum hybrids; (III) to evaluate the best dataset input for the algorithms. A field experiment was carried out in the 2022 crop season in a randomized block design with three replications and six sorghum hybrids. At 60 days after crop emergence, a flight was carried out over the experimental area using the Sensefly eBee real time kinematic. The spectral bands (SB) acquired by the sensor were: blue (475 nm, B_475), green (550 nm, G_550), red (660 nm, R_660), Rededge (735 nm, RE_735) e NIR (790 nm, NIR_790). From the SB acquired, vegetation indices (VIs) were calculated. Data were submitted to ML classification analysis, in which three input settings (using only SB, using only VIs, and using SB + VIs) and six algorithms were tested: artificial neural networks (ANN), support vector machine (SVM), J48 decision trees (J48), random forest (RF), REPTree (DT) and logistic regression (LR, conventional technique used as a control). There were differences in the spectral signature of each sorghum hybrid, which made it possible to differentiate them using SBs and VIs. The ANN algorithm performed best for the three accuracy metrics tested, regardless of the input used. In this case, the use of SB is feasible due to the speed and practicality of analyzing the data, as it does not require calculations to perform the VIs. RF showed better accuracy when VIs were used as an input. The use of VIs provided the best performance for all the algorithms, as did the use of SB + VIs which provided good performance for all the algorithms except RF. Using ML algorithms provides accurate identification of the hybrids, in which ANNs using only SB and RF using VIs as inputs stand out (above 55 for CC, above 0.4 for kappa and around 0.6 for F-score). There were differences in the spectral signature of each sorghum hybrid, which makes it possible to differentiate them using wavelengths and vegetation indices. Processing the multispectral data using machine learning techniques made it possible to accurately differentiate the hybrids, with emphasis on artificial neural networks using spectral bands as inputs and random forest using vegetation indices as inputs.
first_indexed 2024-03-08T09:59:46Z
format Article
id doaj.art-56c4934bbe814de8a788b6536754a74d
institution Directory Open Access Journal
issn 1999-4893
language English
last_indexed 2024-03-08T09:59:46Z
publishDate 2024-01-01
publisher MDPI AG
record_format Article
series Algorithms
spelling doaj.art-56c4934bbe814de8a788b6536754a74d2024-01-29T13:41:24ZengMDPI AGAlgorithms1999-48932024-01-011712310.3390/a17010023A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine LearningDthenifer Cordeiro Santana0Gustavo de Faria Theodoro1Ricardo Gava2João Lucas Gouveia de Oliveira3Larissa Pereira Ribeiro Teodoro4Izabela Cristina de Oliveira5Fábio Henrique Rojo Baio6Carlos Antonio da Silva Junior7Job Teixeira de Oliveira8Paulo Eduardo Teodoro9Department of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Agronomy, State University of São Paulo (UNESP), Ilha Solteira 15385-000, SP, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Geography, State University of Mato Grosso (UNEMAT), Sinop 78550-000, MT, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilDepartment of Agronomy, Campus of Chapadão do Sul, Federal University of Mato Grosso do Sul (UFMS), Chapad ão do Sul 79560-000, MS, BrazilUsing multispectral sensors attached to unmanned aerial vehicles (UAVs) can assist in the collection of morphological and physiological information from several crops. This approach, also known as high-throughput phenotyping, combined with data processing by machine learning (ML) algorithms, can provide fast, accurate, and large-scale discrimination of genotypes in the field, which is crucial for improving the efficiency of breeding programs. Despite their importance, studies aimed at accurately classifying sorghum hybrids using spectral variables as input sets in ML models are still scarce in the literature. Against this backdrop, this study aimed: (I) to discriminate sorghum hybrids based on canopy reflectance in different spectral bands (SB) and vegetation indices (VIs); (II) to evaluate the performance of ML algorithms in classifying sorghum hybrids; (III) to evaluate the best dataset input for the algorithms. A field experiment was carried out in the 2022 crop season in a randomized block design with three replications and six sorghum hybrids. At 60 days after crop emergence, a flight was carried out over the experimental area using the Sensefly eBee real time kinematic. The spectral bands (SB) acquired by the sensor were: blue (475 nm, B_475), green (550 nm, G_550), red (660 nm, R_660), Rededge (735 nm, RE_735) e NIR (790 nm, NIR_790). From the SB acquired, vegetation indices (VIs) were calculated. Data were submitted to ML classification analysis, in which three input settings (using only SB, using only VIs, and using SB + VIs) and six algorithms were tested: artificial neural networks (ANN), support vector machine (SVM), J48 decision trees (J48), random forest (RF), REPTree (DT) and logistic regression (LR, conventional technique used as a control). There were differences in the spectral signature of each sorghum hybrid, which made it possible to differentiate them using SBs and VIs. The ANN algorithm performed best for the three accuracy metrics tested, regardless of the input used. In this case, the use of SB is feasible due to the speed and practicality of analyzing the data, as it does not require calculations to perform the VIs. RF showed better accuracy when VIs were used as an input. The use of VIs provided the best performance for all the algorithms, as did the use of SB + VIs which provided good performance for all the algorithms except RF. Using ML algorithms provides accurate identification of the hybrids, in which ANNs using only SB and RF using VIs as inputs stand out (above 55 for CC, above 0.4 for kappa and around 0.6 for F-score). There were differences in the spectral signature of each sorghum hybrid, which makes it possible to differentiate them using wavelengths and vegetation indices. Processing the multispectral data using machine learning techniques made it possible to accurately differentiate the hybrids, with emphasis on artificial neural networks using spectral bands as inputs and random forest using vegetation indices as inputs.https://www.mdpi.com/1999-4893/17/1/23artificial neural networkshigh-throughput phenotypingrandom forestspectral bandsvegetation index
spellingShingle Dthenifer Cordeiro Santana
Gustavo de Faria Theodoro
Ricardo Gava
João Lucas Gouveia de Oliveira
Larissa Pereira Ribeiro Teodoro
Izabela Cristina de Oliveira
Fábio Henrique Rojo Baio
Carlos Antonio da Silva Junior
Job Teixeira de Oliveira
Paulo Eduardo Teodoro
A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning
Algorithms
artificial neural networks
high-throughput phenotyping
random forest
spectral bands
vegetation index
title A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning
title_full A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning
title_fullStr A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning
title_full_unstemmed A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning
title_short A New Approach to Identifying Sorghum Hybrids Using UAV Imagery Using Multispectral Signature and Machine Learning
title_sort new approach to identifying sorghum hybrids using uav imagery using multispectral signature and machine learning
topic artificial neural networks
high-throughput phenotyping
random forest
spectral bands
vegetation index
url https://www.mdpi.com/1999-4893/17/1/23
work_keys_str_mv AT dthenifercordeirosantana anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT gustavodefariatheodoro anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT ricardogava anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT joaolucasgouveiadeoliveira anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT larissapereiraribeiroteodoro anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT izabelacristinadeoliveira anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT fabiohenriquerojobaio anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT carlosantoniodasilvajunior anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT jobteixeiradeoliveira anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT pauloeduardoteodoro anewapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT dthenifercordeirosantana newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT gustavodefariatheodoro newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT ricardogava newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT joaolucasgouveiadeoliveira newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT larissapereiraribeiroteodoro newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT izabelacristinadeoliveira newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT fabiohenriquerojobaio newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT carlosantoniodasilvajunior newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT jobteixeiradeoliveira newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning
AT pauloeduardoteodoro newapproachtoidentifyingsorghumhybridsusinguavimageryusingmultispectralsignatureandmachinelearning