Diffuse reflectance mid-infrared spectroscopy is viable without fine milling

While diffuse reflectance Fourier transform mid-infrared spectroscopy (mid-DRIFTS) has been established as a viable low-cost surrogate for traditional soil analyses, the assumed need for fine milling of soil samples prior to analysis is constraining the commercial appeal of this technology. Here, we...

Full description

Bibliographic Details
Main Authors: Jonathan Sanderman, Colleen Smith, José Lucas Safanelli, Cristine L.S. Morgan, Jason Ackerson, Nathaniel Looker, Cara Mathers, Rebecca Keating, Ashok A. Kumar
Format: Article
Language:English
Published: Elsevier 2023-12-01
Series:Soil Security
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2667006223000217
_version_ 1797390336078643200
author Jonathan Sanderman
Colleen Smith
José Lucas Safanelli
Cristine L.S. Morgan
Jason Ackerson
Nathaniel Looker
Cara Mathers
Rebecca Keating
Ashok A. Kumar
author_facet Jonathan Sanderman
Colleen Smith
José Lucas Safanelli
Cristine L.S. Morgan
Jason Ackerson
Nathaniel Looker
Cara Mathers
Rebecca Keating
Ashok A. Kumar
author_sort Jonathan Sanderman
collection DOAJ
description While diffuse reflectance Fourier transform mid-infrared spectroscopy (mid-DRIFTS) has been established as a viable low-cost surrogate for traditional soil analyses, the assumed need for fine milling of soil samples prior to analysis is constraining the commercial appeal of this technology. Here, we reevaluate this assumption using a set of 2380 soil samples collected across North American agricultural soils. Cross-validation indicated that the best preprocessing (standard normal variate) and model form (memory-based learning) resulted in very good and nearly identical predictions for the <2 mm preparation and fine-milled preparation of these soils for total organic carbon (TOC), clay, sand, pH and bulk density (BD). Application of larger models built from the USDA NRCS mid-DRIFTS library also resulted in minimal performance differences between the two sample preps. Lower predictive performance of the existing library was attributed to less-than-perfect spectral representativeness of the library. Regardless of model form, there was very little variability between replicates of the <2 mm prep, suggesting that the lack of fine milling did not lead to more heterogeneous subsamples. Additionally, there was no relationship between residual error and soil texture, implying these results should be robust across most soil types. Overall, in agreement with other recent findings, these results suggest that routine scanning of standard <2 mm preparation does not degrade predictive performance of mid-DRIFTS-based inference systems. With good standard operating procedures including quality control and traditional analysis on a small percent of samples, mid-DRIFTS can become a routine tool in commercial soil laboratories.
first_indexed 2024-03-08T23:10:16Z
format Article
id doaj.art-410fdb1f2da04f5c93e5878fd065cdd5
institution Directory Open Access Journal
issn 2667-0062
language English
last_indexed 2024-03-08T23:10:16Z
publishDate 2023-12-01
publisher Elsevier
record_format Article
series Soil Security
spelling doaj.art-410fdb1f2da04f5c93e5878fd065cdd52023-12-15T07:26:57ZengElsevierSoil Security2667-00622023-12-0113100104Diffuse reflectance mid-infrared spectroscopy is viable without fine millingJonathan Sanderman0Colleen Smith1José Lucas Safanelli2Cristine L.S. Morgan3Jason Ackerson4Nathaniel Looker5Cara Mathers6Rebecca Keating7Ashok A. Kumar8Woodwell Climate Research Center, Falmouth MA 02540 USA; Corresponding author.Woodwell Climate Research Center, Falmouth MA 02540 USAWoodwell Climate Research Center, Falmouth MA 02540 USASoil Health Institute, Morrisville, NC 27560 USASoil Health Institute, Morrisville, NC 27560 USASoil Health Institute, Morrisville, NC 27560 USAIndigo Ag, Boston MA 02129 USAIndigo Ag, Boston MA 02129 USAIndigo Ag, Boston MA 02129 USAWhile diffuse reflectance Fourier transform mid-infrared spectroscopy (mid-DRIFTS) has been established as a viable low-cost surrogate for traditional soil analyses, the assumed need for fine milling of soil samples prior to analysis is constraining the commercial appeal of this technology. Here, we reevaluate this assumption using a set of 2380 soil samples collected across North American agricultural soils. Cross-validation indicated that the best preprocessing (standard normal variate) and model form (memory-based learning) resulted in very good and nearly identical predictions for the <2 mm preparation and fine-milled preparation of these soils for total organic carbon (TOC), clay, sand, pH and bulk density (BD). Application of larger models built from the USDA NRCS mid-DRIFTS library also resulted in minimal performance differences between the two sample preps. Lower predictive performance of the existing library was attributed to less-than-perfect spectral representativeness of the library. Regardless of model form, there was very little variability between replicates of the <2 mm prep, suggesting that the lack of fine milling did not lead to more heterogeneous subsamples. Additionally, there was no relationship between residual error and soil texture, implying these results should be robust across most soil types. Overall, in agreement with other recent findings, these results suggest that routine scanning of standard <2 mm preparation does not degrade predictive performance of mid-DRIFTS-based inference systems. With good standard operating procedures including quality control and traditional analysis on a small percent of samples, mid-DRIFTS can become a routine tool in commercial soil laboratories.http://www.sciencedirect.com/science/article/pii/S2667006223000217Soil spectroscopyLaboratory analysisChemometricsSoil carbonSoil texture
spellingShingle Jonathan Sanderman
Colleen Smith
José Lucas Safanelli
Cristine L.S. Morgan
Jason Ackerson
Nathaniel Looker
Cara Mathers
Rebecca Keating
Ashok A. Kumar
Diffuse reflectance mid-infrared spectroscopy is viable without fine milling
Soil Security
Soil spectroscopy
Laboratory analysis
Chemometrics
Soil carbon
Soil texture
title Diffuse reflectance mid-infrared spectroscopy is viable without fine milling
title_full Diffuse reflectance mid-infrared spectroscopy is viable without fine milling
title_fullStr Diffuse reflectance mid-infrared spectroscopy is viable without fine milling
title_full_unstemmed Diffuse reflectance mid-infrared spectroscopy is viable without fine milling
title_short Diffuse reflectance mid-infrared spectroscopy is viable without fine milling
title_sort diffuse reflectance mid infrared spectroscopy is viable without fine milling
topic Soil spectroscopy
Laboratory analysis
Chemometrics
Soil carbon
Soil texture
url http://www.sciencedirect.com/science/article/pii/S2667006223000217
work_keys_str_mv AT jonathansanderman diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT colleensmith diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT joselucassafanelli diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT cristinelsmorgan diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT jasonackerson diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT nathaniellooker diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT caramathers diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT rebeccakeating diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling
AT ashokakumar diffusereflectancemidinfraredspectroscopyisviablewithoutfinemilling