Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry
The bottleneck in plant breeding programs is to have cost-effective high-throughput phenotyping methodologies to efficiently describe the new lines and hybrids developed. In this paper, we propose a fully automatic approach to overcome not only the individual maize extraction but also the trait quan...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Drones |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2504-446X/7/2/108 |
| _version_ | 1797621435607285760 |
|---|---|
| author | Monica Herrero-Huerta Diego Gonzalez-Aguilera Yang Yang |
| author_facet | Monica Herrero-Huerta Diego Gonzalez-Aguilera Yang Yang |
| author_sort | Monica Herrero-Huerta |
| collection | DOAJ |
| description | The bottleneck in plant breeding programs is to have cost-effective high-throughput phenotyping methodologies to efficiently describe the new lines and hybrids developed. In this paper, we propose a fully automatic approach to overcome not only the individual maize extraction but also the trait quantification challenge of structural components from unmanned aerial system (UAS) imagery. The experimental setup was carried out at the Indiana Corn and Soybean Innovation Center at the Agronomy Center for Research and Education (ACRE) in West Lafayette (IN, USA). On 27 July and 3 August 2021, two flights were performed over maize trials using a custom-designed UAS platform with a Sony Alpha ILCE-7R photogrammetric sensor onboard. RGB images were processed using a standard photogrammetric pipeline based on structure from motion (SfM) to obtain a final scaled 3D point cloud of the study field. Individual plants were extracted by, first, semantically segmenting the point cloud into ground and maize using 3D deep learning. Secondly, we employed a connected component algorithm to the maize end-members. Finally, once individual plants were accurately extracted, we robustly applied a Laplacian-based contraction skeleton algorithm to compute several structural component traits from each plant. The results from phenotypic traits such as height and number of leaves show a determination coefficient (R<sup>2</sup>) with on-field and digital measurements, respectively, better than 90%. Our test trial reveals the viability of extracting several phenotypic traits of individual maize using a skeletonization approach on the basis of a UAS imagery-based point cloud. As a limitation of the methodology proposed, we highlight that the lack of plant occlusions in the UAS images obtains a more complete point cloud of the plant, giving more accuracy in the extracted traits. |
| first_indexed | 2024-03-11T08:55:54Z |
| format | Article |
| id | doaj.art-6d1fbc2e499e45c6af79c40fc4b032e1 |
| institution | Directory Open Access Journal |
| issn | 2504-446X |
| language | English |
| last_indexed | 2024-03-11T08:55:54Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Drones |
| spelling | doaj.art-6d1fbc2e499e45c6af79c40fc4b032e12023-11-16T20:06:43ZengMDPI AGDrones2504-446X2023-02-017210810.3390/drones7020108Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion PhotogrammetryMonica Herrero-Huerta0Diego Gonzalez-Aguilera1Yang Yang2Department of Cartographic and Land Engineering, Higher Polytechnic School of Avila, Universidad de Salamanca, Hornos Caleros 50, 05003 Avila, SpainDepartment of Cartographic and Land Engineering, Higher Polytechnic School of Avila, Universidad de Salamanca, Hornos Caleros 50, 05003 Avila, SpainInstitute for Plant Sciences, College of Agriculture, Purdue University, West Lafayette, IN 47906, USAThe bottleneck in plant breeding programs is to have cost-effective high-throughput phenotyping methodologies to efficiently describe the new lines and hybrids developed. In this paper, we propose a fully automatic approach to overcome not only the individual maize extraction but also the trait quantification challenge of structural components from unmanned aerial system (UAS) imagery. The experimental setup was carried out at the Indiana Corn and Soybean Innovation Center at the Agronomy Center for Research and Education (ACRE) in West Lafayette (IN, USA). On 27 July and 3 August 2021, two flights were performed over maize trials using a custom-designed UAS platform with a Sony Alpha ILCE-7R photogrammetric sensor onboard. RGB images were processed using a standard photogrammetric pipeline based on structure from motion (SfM) to obtain a final scaled 3D point cloud of the study field. Individual plants were extracted by, first, semantically segmenting the point cloud into ground and maize using 3D deep learning. Secondly, we employed a connected component algorithm to the maize end-members. Finally, once individual plants were accurately extracted, we robustly applied a Laplacian-based contraction skeleton algorithm to compute several structural component traits from each plant. The results from phenotypic traits such as height and number of leaves show a determination coefficient (R<sup>2</sup>) with on-field and digital measurements, respectively, better than 90%. Our test trial reveals the viability of extracting several phenotypic traits of individual maize using a skeletonization approach on the basis of a UAS imagery-based point cloud. As a limitation of the methodology proposed, we highlight that the lack of plant occlusions in the UAS images obtains a more complete point cloud of the plant, giving more accuracy in the extracted traits.https://www.mdpi.com/2504-446X/7/2/108phenotypingunmanned aerial vehicle (UAV)photogrammetryskeletondeep learning |
| spellingShingle | Monica Herrero-Huerta Diego Gonzalez-Aguilera Yang Yang Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry Drones phenotyping unmanned aerial vehicle (UAV) photogrammetry skeleton deep learning |
| title | Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry |
| title_full | Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry |
| title_fullStr | Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry |
| title_full_unstemmed | Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry |
| title_short | Structural Component Phenotypic Traits from Individual Maize Skeletonization by UAS-Based Structure-from-Motion Photogrammetry |
| title_sort | structural component phenotypic traits from individual maize skeletonization by uas based structure from motion photogrammetry |
| topic | phenotyping unmanned aerial vehicle (UAV) photogrammetry skeleton deep learning |
| url | https://www.mdpi.com/2504-446X/7/2/108 |
| work_keys_str_mv | AT monicaherrerohuerta structuralcomponentphenotypictraitsfromindividualmaizeskeletonizationbyuasbasedstructurefrommotionphotogrammetry AT diegogonzalezaguilera structuralcomponentphenotypictraitsfromindividualmaizeskeletonizationbyuasbasedstructurefrommotionphotogrammetry AT yangyang structuralcomponentphenotypictraitsfromindividualmaizeskeletonizationbyuasbasedstructurefrommotionphotogrammetry |