Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data
Recently, the use of Near Infrared (NIR) spectral sensor in agricultural process is getting much attention, particularly for fruit quality evaluation. The sensor requires a spectrometer to produce some sufficient information called spectrum as interaction between physical matters of the sample with...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2018
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/73814/1/Robust%20generalized%20multiplicative%20scatter%20correction%20algorithm%20on%20pretreatment%20of%20near%20infrared%20spectral%20data.pdf |
| _version_ | 1796979636482080768 |
|---|---|
| author | Silalahi, Divo Dharma Midi, Habshah Arasan, Jayanthi Mustafa, Mohd Shafie Caliman, Jean-Pierre |
| author_facet | Silalahi, Divo Dharma Midi, Habshah Arasan, Jayanthi Mustafa, Mohd Shafie Caliman, Jean-Pierre |
| author_sort | Silalahi, Divo Dharma |
| collection | UPM |
| description | Recently, the use of Near Infrared (NIR) spectral sensor in agricultural process is getting much attention, particularly for fruit quality evaluation. The sensor requires a spectrometer to produce some sufficient information called spectrum as interaction between physical matters of the sample with the electromagnetic spectrum. In fact, the presence of experimental error or/and measurement error due to the heterogeneous particle size, moisture content variability, sample density, the instrument noise and pretreatment experience are often cannot be avoided. These would damage the spectra collected which results to decrease the performance in model selection, and increases the prediction error as the harmful influence of possible outlier and leverage points in dataset. To encounter these, a robust pretreatment of NIR spectral data is needed to correct the spectra before it is used for post-processing using any statistical method. In this paper, several different classical pretreatment methods were evaluated and a new robust Generalized Multiplicative Scatter Correction (GMSC) algorithm was proposed to correct the additive and/or multiplicative baseline effects in the spectral data. A dataset of NIR spectral on oil palm (Elaeis guineensis Jacq.) fruit bunch was used in the simulation. In the simulation, a number of repetitions using the single and double cross validation with robust partial least square are also applied. The Desirability Indices as statistical measures are presented for evaluating the methods. |
| first_indexed | 2024-03-06T10:11:48Z |
| format | Article |
| id | upm.eprints-73814 |
| institution | Universiti Putra Malaysia |
| language | English |
| last_indexed | 2024-03-06T10:11:48Z |
| publishDate | 2018 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | upm.eprints-738142020-05-06T17:49:07Z http://psasir.upm.edu.my/id/eprint/73814/ Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data Silalahi, Divo Dharma Midi, Habshah Arasan, Jayanthi Mustafa, Mohd Shafie Caliman, Jean-Pierre Recently, the use of Near Infrared (NIR) spectral sensor in agricultural process is getting much attention, particularly for fruit quality evaluation. The sensor requires a spectrometer to produce some sufficient information called spectrum as interaction between physical matters of the sample with the electromagnetic spectrum. In fact, the presence of experimental error or/and measurement error due to the heterogeneous particle size, moisture content variability, sample density, the instrument noise and pretreatment experience are often cannot be avoided. These would damage the spectra collected which results to decrease the performance in model selection, and increases the prediction error as the harmful influence of possible outlier and leverage points in dataset. To encounter these, a robust pretreatment of NIR spectral data is needed to correct the spectra before it is used for post-processing using any statistical method. In this paper, several different classical pretreatment methods were evaluated and a new robust Generalized Multiplicative Scatter Correction (GMSC) algorithm was proposed to correct the additive and/or multiplicative baseline effects in the spectral data. A dataset of NIR spectral on oil palm (Elaeis guineensis Jacq.) fruit bunch was used in the simulation. In the simulation, a number of repetitions using the single and double cross validation with robust partial least square are also applied. The Desirability Indices as statistical measures are presented for evaluating the methods. Elsevier 2018 Article PeerReviewed text en http://psasir.upm.edu.my/id/eprint/73814/1/Robust%20generalized%20multiplicative%20scatter%20correction%20algorithm%20on%20pretreatment%20of%20near%20infrared%20spectral%20data.pdf Silalahi, Divo Dharma and Midi, Habshah and Arasan, Jayanthi and Mustafa, Mohd Shafie and Caliman, Jean-Pierre (2018) Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data. Vibrational Spectroscopy, 97. 55 - 65. ISSN 0924-2031 10.1016/j.vibspec.2018.05.002 |
| spellingShingle | Silalahi, Divo Dharma Midi, Habshah Arasan, Jayanthi Mustafa, Mohd Shafie Caliman, Jean-Pierre Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| title | Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| title_full | Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| title_fullStr | Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| title_full_unstemmed | Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| title_short | Robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| title_sort | robust generalized multiplicative scatter correction algorithm on pretreatment of near infrared spectral data |
| url | http://psasir.upm.edu.my/id/eprint/73814/1/Robust%20generalized%20multiplicative%20scatter%20correction%20algorithm%20on%20pretreatment%20of%20near%20infrared%20spectral%20data.pdf |
| work_keys_str_mv | AT silalahidivodharma robustgeneralizedmultiplicativescattercorrectionalgorithmonpretreatmentofnearinfraredspectraldata AT midihabshah robustgeneralizedmultiplicativescattercorrectionalgorithmonpretreatmentofnearinfraredspectraldata AT arasanjayanthi robustgeneralizedmultiplicativescattercorrectionalgorithmonpretreatmentofnearinfraredspectraldata AT mustafamohdshafie robustgeneralizedmultiplicativescattercorrectionalgorithmonpretreatmentofnearinfraredspectraldata AT calimanjeanpierre robustgeneralizedmultiplicativescattercorrectionalgorithmonpretreatmentofnearinfraredspectraldata |