Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX

Wheat ears in unmanned aerial vehicles (UAV) orthophotos are characterized by occlusion, small targets, dense distribution, and complex backgrounds. Rapid identification of wheat ears in UAV orthophotos in a field environment is critical for wheat yield prediction. Three improvements were achieved b...

Full description

Bibliographic Details
Main Authors: Yao Zhaosheng, Liu Tao, Yang Tianle, Ju Chengxin, Sun Chengming
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-04-01
Series:Frontiers in Plant Science
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpls.2022.851245/full
_version_ 1828467095598268416
author Yao Zhaosheng
Yao Zhaosheng
Liu Tao
Liu Tao
Yang Tianle
Yang Tianle
Ju Chengxin
Ju Chengxin
Sun Chengming
Sun Chengming
author_facet Yao Zhaosheng
Yao Zhaosheng
Liu Tao
Liu Tao
Yang Tianle
Yang Tianle
Ju Chengxin
Ju Chengxin
Sun Chengming
Sun Chengming
author_sort Yao Zhaosheng
collection DOAJ
description Wheat ears in unmanned aerial vehicles (UAV) orthophotos are characterized by occlusion, small targets, dense distribution, and complex backgrounds. Rapid identification of wheat ears in UAV orthophotos in a field environment is critical for wheat yield prediction. Three improvements were achieved based on YOLOX-m: mosaic optimized, using BiFPN structure, and attention mechanism, then ablation experiments were performed to verify the effect of each improvement. Three scene datasets were established: images were acquired during three different growing periods, at three planting densities, and under three scenarios of UAV flight heights. In ablation experiments, three improvements had increased recognition accuracies on the experimental dataset. Compared the accuracy of the standard model with our improved model on three scene datasets. Our improved model during three different periods, at three planting densities, and under three scenarios of the UAV flight height, obtaining 88.03%, 87.59%, and 87.93% accuracies, which were, respectively, 2.54%, 1.89%, and 2.15% better than the original model. The results of this study showed that the improved YOLOX-m model can achieve UAV orthophoto wheat recognition under different practical scenarios in large fields, and that the best combination were obtained images from the wheat milk stage, low planting density, and low flight altitude.
first_indexed 2024-12-11T04:00:20Z
format Article
id doaj.art-fd9e9fe2204844f79e13328d8c099189
institution Directory Open Access Journal
issn 1664-462X
language English
last_indexed 2024-12-11T04:00:20Z
publishDate 2022-04-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Plant Science
spelling doaj.art-fd9e9fe2204844f79e13328d8c0991892022-12-22T01:21:40ZengFrontiers Media S.A.Frontiers in Plant Science1664-462X2022-04-011310.3389/fpls.2022.851245851245Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOXYao Zhaosheng0Yao Zhaosheng1Liu Tao2Liu Tao3Yang Tianle4Yang Tianle5Ju Chengxin6Ju Chengxin7Sun Chengming8Sun Chengming9Jiangsu Key Laboratory of Crop Genetics and Physiology/Jiangsu Key Laboratory of Crop Cultivation and Physiology, Agricultural College of Yangzhou University, Yangzhou, ChinaJiangsu Co-Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, ChinaJiangsu Key Laboratory of Crop Genetics and Physiology/Jiangsu Key Laboratory of Crop Cultivation and Physiology, Agricultural College of Yangzhou University, Yangzhou, ChinaJiangsu Co-Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, ChinaJiangsu Key Laboratory of Crop Genetics and Physiology/Jiangsu Key Laboratory of Crop Cultivation and Physiology, Agricultural College of Yangzhou University, Yangzhou, ChinaJiangsu Co-Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, ChinaJiangsu Key Laboratory of Crop Genetics and Physiology/Jiangsu Key Laboratory of Crop Cultivation and Physiology, Agricultural College of Yangzhou University, Yangzhou, ChinaJiangsu Co-Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, ChinaJiangsu Key Laboratory of Crop Genetics and Physiology/Jiangsu Key Laboratory of Crop Cultivation and Physiology, Agricultural College of Yangzhou University, Yangzhou, ChinaJiangsu Co-Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, ChinaWheat ears in unmanned aerial vehicles (UAV) orthophotos are characterized by occlusion, small targets, dense distribution, and complex backgrounds. Rapid identification of wheat ears in UAV orthophotos in a field environment is critical for wheat yield prediction. Three improvements were achieved based on YOLOX-m: mosaic optimized, using BiFPN structure, and attention mechanism, then ablation experiments were performed to verify the effect of each improvement. Three scene datasets were established: images were acquired during three different growing periods, at three planting densities, and under three scenarios of UAV flight heights. In ablation experiments, three improvements had increased recognition accuracies on the experimental dataset. Compared the accuracy of the standard model with our improved model on three scene datasets. Our improved model during three different periods, at three planting densities, and under three scenarios of the UAV flight height, obtaining 88.03%, 87.59%, and 87.93% accuracies, which were, respectively, 2.54%, 1.89%, and 2.15% better than the original model. The results of this study showed that the improved YOLOX-m model can achieve UAV orthophoto wheat recognition under different practical scenarios in large fields, and that the best combination were obtained images from the wheat milk stage, low planting density, and low flight altitude.https://www.frontiersin.org/articles/10.3389/fpls.2022.851245/fullsmall targetspikeYOLOXUAVOrthophotoBiFPN
spellingShingle Yao Zhaosheng
Yao Zhaosheng
Liu Tao
Liu Tao
Yang Tianle
Yang Tianle
Ju Chengxin
Ju Chengxin
Sun Chengming
Sun Chengming
Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX
Frontiers in Plant Science
small target
spike
YOLOX
UAV
Orthophoto
BiFPN
title Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX
title_full Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX
title_fullStr Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX
title_full_unstemmed Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX
title_short Rapid Detection of Wheat Ears in Orthophotos From Unmanned Aerial Vehicles in Fields Based on YOLOX
title_sort rapid detection of wheat ears in orthophotos from unmanned aerial vehicles in fields based on yolox
topic small target
spike
YOLOX
UAV
Orthophoto
BiFPN
url https://www.frontiersin.org/articles/10.3389/fpls.2022.851245/full
work_keys_str_mv AT yaozhaosheng rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT yaozhaosheng rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT liutao rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT liutao rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT yangtianle rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT yangtianle rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT juchengxin rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT juchengxin rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT sunchengming rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox
AT sunchengming rapiddetectionofwheatearsinorthophotosfromunmannedaerialvehiclesinfieldsbasedonyolox