Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion

Powdery mildew severely affects wheat growth and yield; therefore, its effective monitoring is essential for the prevention and control of the disease and global food security. In the present study, a spectroradiometer and thermal infrared cameras were used to obtain hyperspectral signature and ther...

Full description

Bibliographic Details
Main Authors: Ziheng Feng, Li Song, Jianzhao Duan, Li He, Yanyan Zhang, Yongkang Wei, Wei Feng
Format: Article
Language:English
Published: MDPI AG 2021-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/1/31
_version_ 1797497699684057088
author Ziheng Feng
Li Song
Jianzhao Duan
Li He
Yanyan Zhang
Yongkang Wei
Wei Feng
author_facet Ziheng Feng
Li Song
Jianzhao Duan
Li He
Yanyan Zhang
Yongkang Wei
Wei Feng
author_sort Ziheng Feng
collection DOAJ
description Powdery mildew severely affects wheat growth and yield; therefore, its effective monitoring is essential for the prevention and control of the disease and global food security. In the present study, a spectroradiometer and thermal infrared cameras were used to obtain hyperspectral signature and thermal infrared images data, and thermal infrared temperature parameters (TP) and texture features (TF) were extracted from the thermal infrared images and RGB images of wheat with powdery mildew, during the wheat flowering and filling periods. Based on the ten vegetation indices from the hyperspectral data (VI), TF and TP were integrated, and partial least square regression, random forest regression (RFR), and support vector machine regression (SVR) algorithms were used to construct a prediction model for a wheat powdery mildew disease index. According to the results, the prediction accuracy of RFR was higher than in other models, under both single data source modeling and multi-source data modeling; among the three data sources, VI was the most suitable for powdery mildew monitoring, followed by TP, and finally TF. The RFR model had stable performance in multi-source data fusion modeling (VI&TP&TF), and had the optimal estimation performance with 0.872 and 0.862 of R<sup>2</sup> for calibration and validation, respectively. The application of multi-source data collaborative modeling could improve the accuracy of remote sensing monitoring of wheat powdery mildew, and facilitate the achievement of high-precision remote sensing monitoring of crop disease status.
first_indexed 2024-03-10T03:22:58Z
format Article
id doaj.art-453dbe348847467bb66f6fdffacb575d
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T03:22:58Z
publishDate 2021-12-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-453dbe348847467bb66f6fdffacb575d2023-11-23T12:15:50ZengMDPI AGSensors1424-82202021-12-012213110.3390/s22010031Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data FusionZiheng Feng0Li Song1Jianzhao Duan2Li He3Yanyan Zhang4Yongkang Wei5Wei Feng6State Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaState Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaState Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaState Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaState Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaState Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaState Key Laboratory of Wheat and Maize Crop Science, Agronomy College, Henan Agriculture University, Zhengzhou 450046, ChinaPowdery mildew severely affects wheat growth and yield; therefore, its effective monitoring is essential for the prevention and control of the disease and global food security. In the present study, a spectroradiometer and thermal infrared cameras were used to obtain hyperspectral signature and thermal infrared images data, and thermal infrared temperature parameters (TP) and texture features (TF) were extracted from the thermal infrared images and RGB images of wheat with powdery mildew, during the wheat flowering and filling periods. Based on the ten vegetation indices from the hyperspectral data (VI), TF and TP were integrated, and partial least square regression, random forest regression (RFR), and support vector machine regression (SVR) algorithms were used to construct a prediction model for a wheat powdery mildew disease index. According to the results, the prediction accuracy of RFR was higher than in other models, under both single data source modeling and multi-source data modeling; among the three data sources, VI was the most suitable for powdery mildew monitoring, followed by TP, and finally TF. The RFR model had stable performance in multi-source data fusion modeling (VI&TP&TF), and had the optimal estimation performance with 0.872 and 0.862 of R<sup>2</sup> for calibration and validation, respectively. The application of multi-source data collaborative modeling could improve the accuracy of remote sensing monitoring of wheat powdery mildew, and facilitate the achievement of high-precision remote sensing monitoring of crop disease status.https://www.mdpi.com/1424-8220/22/1/31wheat powdery mildewmachine learninginformation fusionremote sensing monitoring
spellingShingle Ziheng Feng
Li Song
Jianzhao Duan
Li He
Yanyan Zhang
Yongkang Wei
Wei Feng
Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion
Sensors
wheat powdery mildew
machine learning
information fusion
remote sensing monitoring
title Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion
title_full Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion
title_fullStr Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion
title_full_unstemmed Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion
title_short Monitoring Wheat Powdery Mildew Based on Hyperspectral, Thermal Infrared, and RGB Image Data Fusion
title_sort monitoring wheat powdery mildew based on hyperspectral thermal infrared and rgb image data fusion
topic wheat powdery mildew
machine learning
information fusion
remote sensing monitoring
url https://www.mdpi.com/1424-8220/22/1/31
work_keys_str_mv AT zihengfeng monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion
AT lisong monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion
AT jianzhaoduan monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion
AT lihe monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion
AT yanyanzhang monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion
AT yongkangwei monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion
AT weifeng monitoringwheatpowderymildewbasedonhyperspectralthermalinfraredandrgbimagedatafusion