Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?

Recent developments in diffuse reflectance soil spectroscopy have increasingly focused on building and using large soil spectral libraries with the purpose of supporting many activities relevant to monitoring, mapping and managing soil resources. A potential limitation of using a mid-infrared (MIR)...

Full description

Bibliographic Details
Main Authors: Shree R. S. Dangal, Jonathan Sanderman
Format: Article
Language:English
Published: MDPI AG 2020-11-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/23/6729
_version_ 1827701529569656832
author Shree R. S. Dangal
Jonathan Sanderman
author_facet Shree R. S. Dangal
Jonathan Sanderman
author_sort Shree R. S. Dangal
collection DOAJ
description Recent developments in diffuse reflectance soil spectroscopy have increasingly focused on building and using large soil spectral libraries with the purpose of supporting many activities relevant to monitoring, mapping and managing soil resources. A potential limitation of using a mid-infrared (MIR) spectral library developed by another laboratory is the need to account for inherent differences in the signal strength at each wavelength associated with different instrumental and environmental conditions. Here we apply predictive models built using the USDA National Soil Survey Center–Kellogg Soil Survey Laboratory (NSSC-KSSL) MIR spectral library (<i>n</i> = 56,155) to samples sets of European and US origin scanned on a secondary spectrometer to assess the need for calibration transfer using a piecewise direct standardization (PDS) approach in transforming spectra before predicting carbon cycle relevant soil properties (bulk density, CaCO<sub>3</sub>, organic carbon, clay and pH). The European soil samples were from the land use/cover area frame statistical survey (LUCAS) database available through the European Soil Data Center (ESDAC), while the US soil samples were from the National Ecological Observatory Network (NEON). Additionally, the performance of the predictive models on PDS transfer spectra was tested against the direct calibration models built using samples scanned on the secondary spectrometer. On independent test sets of European and US origin, PDS improved predictions for most but not all soil properties with memory based learning (MBL) models generally outperforming partial least squares regression and Cubist models. Our study suggests that while good-to-excellent results can be obtained without calibration transfer, for most of the cases presented in this study, PDS was necessary for unbiased predictions. The MBL models also outperformed the direct calibration models for most of the soil properties. For laboratories building new spectroscopy capacity utilizing existing spectral libraries, it appears necessary to develop calibration transfer using PDS or other calibration transfer techniques to obtain the least biased and most precise predictions of different soil properties.
first_indexed 2024-03-10T14:35:50Z
format Article
id doaj.art-5892f90d41ab4860a94cd46714bfd8c1
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T14:35:50Z
publishDate 2020-11-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-5892f90d41ab4860a94cd46714bfd8c12023-11-20T22:13:19ZengMDPI AGSensors1424-82202020-11-012023672910.3390/s20236729Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?Shree R. S. Dangal0Jonathan Sanderman1Woodwell Climate Research Center, Falmouth, MA 02540, USAWoodwell Climate Research Center, Falmouth, MA 02540, USARecent developments in diffuse reflectance soil spectroscopy have increasingly focused on building and using large soil spectral libraries with the purpose of supporting many activities relevant to monitoring, mapping and managing soil resources. A potential limitation of using a mid-infrared (MIR) spectral library developed by another laboratory is the need to account for inherent differences in the signal strength at each wavelength associated with different instrumental and environmental conditions. Here we apply predictive models built using the USDA National Soil Survey Center–Kellogg Soil Survey Laboratory (NSSC-KSSL) MIR spectral library (<i>n</i> = 56,155) to samples sets of European and US origin scanned on a secondary spectrometer to assess the need for calibration transfer using a piecewise direct standardization (PDS) approach in transforming spectra before predicting carbon cycle relevant soil properties (bulk density, CaCO<sub>3</sub>, organic carbon, clay and pH). The European soil samples were from the land use/cover area frame statistical survey (LUCAS) database available through the European Soil Data Center (ESDAC), while the US soil samples were from the National Ecological Observatory Network (NEON). Additionally, the performance of the predictive models on PDS transfer spectra was tested against the direct calibration models built using samples scanned on the secondary spectrometer. On independent test sets of European and US origin, PDS improved predictions for most but not all soil properties with memory based learning (MBL) models generally outperforming partial least squares regression and Cubist models. Our study suggests that while good-to-excellent results can be obtained without calibration transfer, for most of the cases presented in this study, PDS was necessary for unbiased predictions. The MBL models also outperformed the direct calibration models for most of the soil properties. For laboratories building new spectroscopy capacity utilizing existing spectral libraries, it appears necessary to develop calibration transfer using PDS or other calibration transfer techniques to obtain the least biased and most precise predictions of different soil properties.https://www.mdpi.com/1424-8220/20/23/6729mid-infrared diffuse reflectance spectroscopycalibration transferpiecewise direct standardization (PDS)soil properties
spellingShingle Shree R. S. Dangal
Jonathan Sanderman
Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?
Sensors
mid-infrared diffuse reflectance spectroscopy
calibration transfer
piecewise direct standardization (PDS)
soil properties
title Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?
title_full Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?
title_fullStr Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?
title_full_unstemmed Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?
title_short Is Standardization Necessary for Sharing of a Large Mid-Infrared Soil Spectral Library?
title_sort is standardization necessary for sharing of a large mid infrared soil spectral library
topic mid-infrared diffuse reflectance spectroscopy
calibration transfer
piecewise direct standardization (PDS)
soil properties
url https://www.mdpi.com/1424-8220/20/23/6729
work_keys_str_mv AT shreersdangal isstandardizationnecessaryforsharingofalargemidinfraredsoilspectrallibrary
AT jonathansanderman isstandardizationnecessaryforsharingofalargemidinfraredsoilspectrallibrary