A spatio temporal spectral framework for plant stress phenotyping
Abstract Background Recent advances in high throughput phenotyping have made it possible to collect large datasets following plant growth and development over time, and those in machine learning have made inferring phenotypic plant traits from such datasets possible. However, there remains a dirth o...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2019-02-01
|
| Series: | Plant Methods |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s13007-019-0398-8 |
| _version_ | 1818409817668059136 |
|---|---|
| author | Raghav Khanna Lukas Schmid Achim Walter Juan Nieto Roland Siegwart Frank Liebisch |
| author_facet | Raghav Khanna Lukas Schmid Achim Walter Juan Nieto Roland Siegwart Frank Liebisch |
| author_sort | Raghav Khanna |
| collection | DOAJ |
| description | Abstract Background Recent advances in high throughput phenotyping have made it possible to collect large datasets following plant growth and development over time, and those in machine learning have made inferring phenotypic plant traits from such datasets possible. However, there remains a dirth of datasets following plant growth under stress conditions along with methods for inferring them using only remotely sensed data, especially under a combination of multiple stress factors such as drought, weeds and nutrient deficiency. Such stress factors and their combinations are commonly encountered during crop production and being able to accurately detect and treat such stress conditions in an automated and timely manner can provide a major boost to farm yields with minimal resource input. Results We present a generic framework for remote plant stress phenotyping that consists of a dataset with spatio-temporal-spectral data following sugarbeet crop growth under optimal, drought, low and surplus nitrogen fertilization, and weed stress conditions, along with a machine learning based methodology for systematically inferring these stress conditions from the remotely measured data. The dataset contains biweekly color images, infra-red stereo image pairs and hyperspectral camera images along with applied treatment parameters and environmental factors like temperature and humidity, collected over two months. We present a plant agnostic methodology for deriving plant trait indicators such as canopy cover, height, hyperspectral reflectance and vegetation indices along with a spectral 3D reconstruction of the plants from the raw data to serve as a benchmark. Additionally, we provide fresh and dry weight measurements for both the above (canopy) and below (beet) ground biomass at the end of the growing period to serve as indicators of expected yield. We further describe a data driven, machine learning based method to infer water, Nitrogen and weed stress using the derived plant trait indicators. We use the plant trait indicators to evaluate 8 different classification approaches from which the best classifier achieved a mean cross validation accuracy of $$\approx$$ ≈ 93, 76 and 83% for drought, nitrogen and weed stress severity classification respectively. We also show that our multi-modal approach significantly improves classifier performance over using any single modality. Conclusion The presented framework and dataset can serve as a valuable reference for creating and comparing processing pipelines which extract plant trait indicators and infer prevalent stress factors from remote sensing data under a variety of environments and cropping conditions. These techniques can then be deployed on farm machinery or robots enabling automated, precise and timely corrective interventions for maximising yield. |
| first_indexed | 2024-12-14T10:05:39Z |
| format | Article |
| id | doaj.art-cef8328b15944f75b828448fbdd58022 |
| institution | Directory Open Access Journal |
| issn | 1746-4811 |
| language | English |
| last_indexed | 2024-12-14T10:05:39Z |
| publishDate | 2019-02-01 |
| publisher | BMC |
| record_format | Article |
| series | Plant Methods |
| spelling | doaj.art-cef8328b15944f75b828448fbdd580222022-12-21T23:07:09ZengBMCPlant Methods1746-48112019-02-0115111810.1186/s13007-019-0398-8A spatio temporal spectral framework for plant stress phenotypingRaghav Khanna0Lukas Schmid1Achim Walter2Juan Nieto3Roland Siegwart4Frank Liebisch5Autonomous Systems Lab, ETH ZürichAutonomous Systems Lab, ETH ZürichCrop Science Group, Department of Environmental Systems Science, ETH ZürichAutonomous Systems Lab, ETH ZürichAutonomous Systems Lab, ETH ZürichCrop Science Group, Department of Environmental Systems Science, ETH ZürichAbstract Background Recent advances in high throughput phenotyping have made it possible to collect large datasets following plant growth and development over time, and those in machine learning have made inferring phenotypic plant traits from such datasets possible. However, there remains a dirth of datasets following plant growth under stress conditions along with methods for inferring them using only remotely sensed data, especially under a combination of multiple stress factors such as drought, weeds and nutrient deficiency. Such stress factors and their combinations are commonly encountered during crop production and being able to accurately detect and treat such stress conditions in an automated and timely manner can provide a major boost to farm yields with minimal resource input. Results We present a generic framework for remote plant stress phenotyping that consists of a dataset with spatio-temporal-spectral data following sugarbeet crop growth under optimal, drought, low and surplus nitrogen fertilization, and weed stress conditions, along with a machine learning based methodology for systematically inferring these stress conditions from the remotely measured data. The dataset contains biweekly color images, infra-red stereo image pairs and hyperspectral camera images along with applied treatment parameters and environmental factors like temperature and humidity, collected over two months. We present a plant agnostic methodology for deriving plant trait indicators such as canopy cover, height, hyperspectral reflectance and vegetation indices along with a spectral 3D reconstruction of the plants from the raw data to serve as a benchmark. Additionally, we provide fresh and dry weight measurements for both the above (canopy) and below (beet) ground biomass at the end of the growing period to serve as indicators of expected yield. We further describe a data driven, machine learning based method to infer water, Nitrogen and weed stress using the derived plant trait indicators. We use the plant trait indicators to evaluate 8 different classification approaches from which the best classifier achieved a mean cross validation accuracy of $$\approx$$ ≈ 93, 76 and 83% for drought, nitrogen and weed stress severity classification respectively. We also show that our multi-modal approach significantly improves classifier performance over using any single modality. Conclusion The presented framework and dataset can serve as a valuable reference for creating and comparing processing pipelines which extract plant trait indicators and infer prevalent stress factors from remote sensing data under a variety of environments and cropping conditions. These techniques can then be deployed on farm machinery or robots enabling automated, precise and timely corrective interventions for maximising yield.http://link.springer.com/article/10.1186/s13007-019-0398-8PhenotypingPlant-stressNitrogenWeedWaterDataset |
| spellingShingle | Raghav Khanna Lukas Schmid Achim Walter Juan Nieto Roland Siegwart Frank Liebisch A spatio temporal spectral framework for plant stress phenotyping Plant Methods Phenotyping Plant-stress Nitrogen Weed Water Dataset |
| title | A spatio temporal spectral framework for plant stress phenotyping |
| title_full | A spatio temporal spectral framework for plant stress phenotyping |
| title_fullStr | A spatio temporal spectral framework for plant stress phenotyping |
| title_full_unstemmed | A spatio temporal spectral framework for plant stress phenotyping |
| title_short | A spatio temporal spectral framework for plant stress phenotyping |
| title_sort | spatio temporal spectral framework for plant stress phenotyping |
| topic | Phenotyping Plant-stress Nitrogen Weed Water Dataset |
| url | http://link.springer.com/article/10.1186/s13007-019-0398-8 |
| work_keys_str_mv | AT raghavkhanna aspatiotemporalspectralframeworkforplantstressphenotyping AT lukasschmid aspatiotemporalspectralframeworkforplantstressphenotyping AT achimwalter aspatiotemporalspectralframeworkforplantstressphenotyping AT juannieto aspatiotemporalspectralframeworkforplantstressphenotyping AT rolandsiegwart aspatiotemporalspectralframeworkforplantstressphenotyping AT frankliebisch aspatiotemporalspectralframeworkforplantstressphenotyping AT raghavkhanna spatiotemporalspectralframeworkforplantstressphenotyping AT lukasschmid spatiotemporalspectralframeworkforplantstressphenotyping AT achimwalter spatiotemporalspectralframeworkforplantstressphenotyping AT juannieto spatiotemporalspectralframeworkforplantstressphenotyping AT rolandsiegwart spatiotemporalspectralframeworkforplantstressphenotyping AT frankliebisch spatiotemporalspectralframeworkforplantstressphenotyping |