Performance metrics for the evaluation of hyperspectral chemical identification systems

Remote sensing of chemical vapor plumes is a difficult but important task for many military and civilian applications. Hyperspectral sensors operating in the long-wave infrared regime have well-demonstrated detection capabilities. However, the identification of a plume’s chemical constituents, based...

Full description

Bibliographic Details
Main Authors: Ingle, Vinay, Truslow, Eric O., Golowich, Steven E., Manolakis, Dimitris G.
Other Authors: Lincoln Laboratory
Format: Article
Language:en_US
Published: SPIE--Society of Photo-Optical Instrumentation Engineers 2017
Online Access:http://hdl.handle.net/1721.1/108594
_version_ 1811091415212490752
author Ingle, Vinay
Truslow, Eric O.
Golowich, Steven E.
Manolakis, Dimitris G.
author2 Lincoln Laboratory
author_facet Lincoln Laboratory
Ingle, Vinay
Truslow, Eric O.
Golowich, Steven E.
Manolakis, Dimitris G.
author_sort Ingle, Vinay
collection MIT
description Remote sensing of chemical vapor plumes is a difficult but important task for many military and civilian applications. Hyperspectral sensors operating in the long-wave infrared regime have well-demonstrated detection capabilities. However, the identification of a plume’s chemical constituents, based on a chemical library, is a multiple hypothesis testing problem which standard detection metrics do not fully describe. We propose using an additional performance metric for identification based on the so-called Dice index. Our approach partitions and weights a confusion matrix to develop both the standard detection metrics and identification metric. Using the proposed metrics, we demonstrate that the intuitive system design of a detector bank followed by an identifier is indeed justified when incorporating performance information beyond the standard detection metrics.
first_indexed 2024-09-23T15:02:03Z
format Article
id mit-1721.1/108594
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T15:02:03Z
publishDate 2017
publisher SPIE--Society of Photo-Optical Instrumentation Engineers
record_format dspace
spelling mit-1721.1/1085942022-09-29T12:11:03Z Performance metrics for the evaluation of hyperspectral chemical identification systems Ingle, Vinay Truslow, Eric O. Golowich, Steven E. Manolakis, Dimitris G. Lincoln Laboratory Truslow, Eric O. Golowich, Steven E. Manolakis, Dimitris G. Remote sensing of chemical vapor plumes is a difficult but important task for many military and civilian applications. Hyperspectral sensors operating in the long-wave infrared regime have well-demonstrated detection capabilities. However, the identification of a plume’s chemical constituents, based on a chemical library, is a multiple hypothesis testing problem which standard detection metrics do not fully describe. We propose using an additional performance metric for identification based on the so-called Dice index. Our approach partitions and weights a confusion matrix to develop both the standard detection metrics and identification metric. Using the proposed metrics, we demonstrate that the intuitive system design of a detector bank followed by an identifier is indeed justified when incorporating performance information beyond the standard detection metrics. United States. Defense Threat Reduction Agency (Air Force contract FA8721-05-C-0002) 2017-05-02T17:29:03Z 2017-05-02T17:29:03Z 2016-02 2015-06 Article http://purl.org/eprint/type/JournalArticle 0091-3286 http://hdl.handle.net/1721.1/108594 Truslow, Eric, Steven Golowich, Dimitris Manolakis, and Vinay Ingle. “Performance Metrics for the Evaluation of Hyperspectral Chemical Identification Systems.” Opt. Eng 55, no. 2 (February 10, 2016): 023106. ©2016 SPIE. en_US http://dx.doi.org/10.1117/1.oe.55.2.023106 Optical Engineering Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf SPIE--Society of Photo-Optical Instrumentation Engineers SPIE
spellingShingle Ingle, Vinay
Truslow, Eric O.
Golowich, Steven E.
Manolakis, Dimitris G.
Performance metrics for the evaluation of hyperspectral chemical identification systems
title Performance metrics for the evaluation of hyperspectral chemical identification systems
title_full Performance metrics for the evaluation of hyperspectral chemical identification systems
title_fullStr Performance metrics for the evaluation of hyperspectral chemical identification systems
title_full_unstemmed Performance metrics for the evaluation of hyperspectral chemical identification systems
title_short Performance metrics for the evaluation of hyperspectral chemical identification systems
title_sort performance metrics for the evaluation of hyperspectral chemical identification systems
url http://hdl.handle.net/1721.1/108594
work_keys_str_mv AT inglevinay performancemetricsfortheevaluationofhyperspectralchemicalidentificationsystems
AT truslowerico performancemetricsfortheevaluationofhyperspectralchemicalidentificationsystems
AT golowichstevene performancemetricsfortheevaluationofhyperspectralchemicalidentificationsystems
AT manolakisdimitrisg performancemetricsfortheevaluationofhyperspectralchemicalidentificationsystems