Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model

The extraction of wheat lodging is of great significance to post-disaster agricultural production management, disaster assessment and insurance subsidies. At present, the recognition of lodging wheat in the actual complex field environment still has low accuracy and poor real-time performance. To ov...

Full description

Bibliographic Details
Main Authors: Baohua Yang, Yue Zhu, Shuaijun Zhou
Format: Article
Language:English
Published: MDPI AG 2021-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/20/6826
_version_ 1797513186046377984
author Baohua Yang
Yue Zhu
Shuaijun Zhou
author_facet Baohua Yang
Yue Zhu
Shuaijun Zhou
author_sort Baohua Yang
collection DOAJ
description The extraction of wheat lodging is of great significance to post-disaster agricultural production management, disaster assessment and insurance subsidies. At present, the recognition of lodging wheat in the actual complex field environment still has low accuracy and poor real-time performance. To overcome this gap, first, four-channel fusion images, including RGB and DSM (digital surface model), as well as RGB and ExG (excess green), were constructed based on the RGB image acquired from unmanned aerial vehicle (UAV). Second, a Mobile U-Net model that combined a lightweight neural network with a depthwise separable convolution and U-Net model was proposed. Finally, three data sets (RGB, RGB + DSM and RGB + ExG) were used to train, verify, test and evaluate the proposed model. The results of the experiment showed that the overall accuracy of lodging recognition based on RGB + DSM reached 88.99%, which is 11.8% higher than that of original RGB and 6.2% higher than that of RGB + ExG. In addition, our proposed model was superior to typical deep learning frameworks in terms of model parameters, processing speed and segmentation accuracy. The optimized Mobile U-Net model reached 9.49 million parameters, which was 27.3% and 33.3% faster than the FCN and U-Net models, respectively. Furthermore, for RGB + DSM wheat lodging extraction, the overall accuracy of Mobile U-Net was improved by 24.3% and 15.3% compared with FCN and U-Net, respectively. Therefore, the Mobile U-Net model using RGB + DSM could extract wheat lodging with higher accuracy, fewer parameters and stronger robustness.
first_indexed 2024-03-10T06:13:07Z
format Article
id doaj.art-401dee0348b6461d87ff25537488762c
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T06:13:07Z
publishDate 2021-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-401dee0348b6461d87ff25537488762c2023-11-22T19:58:04ZengMDPI AGSensors1424-82202021-10-012120682610.3390/s21206826Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network ModelBaohua Yang0Yue Zhu1Shuaijun Zhou2School of Information and Computer, Anhui Agricultural University, Hefei 230036, ChinaSchool of Information and Computer, Anhui Agricultural University, Hefei 230036, ChinaSchool of Information and Computer, Anhui Agricultural University, Hefei 230036, ChinaThe extraction of wheat lodging is of great significance to post-disaster agricultural production management, disaster assessment and insurance subsidies. At present, the recognition of lodging wheat in the actual complex field environment still has low accuracy and poor real-time performance. To overcome this gap, first, four-channel fusion images, including RGB and DSM (digital surface model), as well as RGB and ExG (excess green), were constructed based on the RGB image acquired from unmanned aerial vehicle (UAV). Second, a Mobile U-Net model that combined a lightweight neural network with a depthwise separable convolution and U-Net model was proposed. Finally, three data sets (RGB, RGB + DSM and RGB + ExG) were used to train, verify, test and evaluate the proposed model. The results of the experiment showed that the overall accuracy of lodging recognition based on RGB + DSM reached 88.99%, which is 11.8% higher than that of original RGB and 6.2% higher than that of RGB + ExG. In addition, our proposed model was superior to typical deep learning frameworks in terms of model parameters, processing speed and segmentation accuracy. The optimized Mobile U-Net model reached 9.49 million parameters, which was 27.3% and 33.3% faster than the FCN and U-Net models, respectively. Furthermore, for RGB + DSM wheat lodging extraction, the overall accuracy of Mobile U-Net was improved by 24.3% and 15.3% compared with FCN and U-Net, respectively. Therefore, the Mobile U-Net model using RGB + DSM could extract wheat lodging with higher accuracy, fewer parameters and stronger robustness.https://www.mdpi.com/1424-8220/21/20/6826UAVwheat lodgingdeep learninglightweightdigital surface model (DSM)
spellingShingle Baohua Yang
Yue Zhu
Shuaijun Zhou
Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model
Sensors
UAV
wheat lodging
deep learning
lightweight
digital surface model (DSM)
title Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model
title_full Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model
title_fullStr Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model
title_full_unstemmed Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model
title_short Accurate Wheat Lodging Extraction from Multi-Channel UAV Images Using a Lightweight Network Model
title_sort accurate wheat lodging extraction from multi channel uav images using a lightweight network model
topic UAV
wheat lodging
deep learning
lightweight
digital surface model (DSM)
url https://www.mdpi.com/1424-8220/21/20/6826
work_keys_str_mv AT baohuayang accuratewheatlodgingextractionfrommultichanneluavimagesusingalightweightnetworkmodel
AT yuezhu accuratewheatlodgingextractionfrommultichanneluavimagesusingalightweightnetworkmodel
AT shuaijunzhou accuratewheatlodgingextractionfrommultichanneluavimagesusingalightweightnetworkmodel