CASMI: And the Winner is . . .

The Critical Assessment of Small Molecule Identification (CASMI) Contest was founded in 2012 to provide scientists with a common open dataset to evaluate their identification methods. In this review, we summarize the submissions, evaluate procedures and discuss the results. We received five submissi...

Full description

Bibliographic Details
Main Authors: Steffen Neumann, Emma L. Schymanski
Format: Article
Language:English
Published: MDPI AG 2013-05-01
Series:Metabolites
Subjects:
Online Access:http://www.mdpi.com/2218-1989/3/2/412
_version_ 1828399648338870272
author Steffen Neumann
Emma L. Schymanski
author_facet Steffen Neumann
Emma L. Schymanski
author_sort Steffen Neumann
collection DOAJ
description The Critical Assessment of Small Molecule Identification (CASMI) Contest was founded in 2012 to provide scientists with a common open dataset to evaluate their identification methods. In this review, we summarize the submissions, evaluate procedures and discuss the results. We received five submissions (three external, two internal) for LC–MS Category 1 (best molecular formula) and six submissions (three external, three internal) for LC–MS Category 2 (best molecular structure). No external submissions were received for the GC–MS Categories 3 and 4. The team of Dunn et al. from Birmingham had the most answers in the 1st place for Category 1, while Category 2 was won by H. Oberacher. Despite the low number of participants, the external and internal submissions cover a broad range of identification strategies, including expert knowledge, database searching, automated methods and structure generation. The results of Category 1 show that complementing automated strategies with (manual) expert knowledge was the most successful approach, while no automated method could compete with the power of spectral searching for Category 2—if the challenge was present in a spectral library. Every participant topped at least one challenge, showing that different approaches are still necessary for interpretation diversity.
first_indexed 2024-12-10T09:20:27Z
format Article
id doaj.art-a59e8f97242c43e8a5fa0e7f58cc5613
institution Directory Open Access Journal
issn 2218-1989
language English
last_indexed 2024-12-10T09:20:27Z
publishDate 2013-05-01
publisher MDPI AG
record_format Article
series Metabolites
spelling doaj.art-a59e8f97242c43e8a5fa0e7f58cc56132022-12-22T01:54:43ZengMDPI AGMetabolites2218-19892013-05-013241243910.3390/metabo3020412CASMI: And the Winner is . . .Steffen NeumannEmma L. SchymanskiThe Critical Assessment of Small Molecule Identification (CASMI) Contest was founded in 2012 to provide scientists with a common open dataset to evaluate their identification methods. In this review, we summarize the submissions, evaluate procedures and discuss the results. We received five submissions (three external, two internal) for LC–MS Category 1 (best molecular formula) and six submissions (three external, three internal) for LC–MS Category 2 (best molecular structure). No external submissions were received for the GC–MS Categories 3 and 4. The team of Dunn et al. from Birmingham had the most answers in the 1st place for Category 1, while Category 2 was won by H. Oberacher. Despite the low number of participants, the external and internal submissions cover a broad range of identification strategies, including expert knowledge, database searching, automated methods and structure generation. The results of Category 1 show that complementing automated strategies with (manual) expert knowledge was the most successful approach, while no automated method could compete with the power of spectral searching for Category 2—if the challenge was present in a spectral library. Every participant topped at least one challenge, showing that different approaches are still necessary for interpretation diversity.http://www.mdpi.com/2218-1989/3/2/412mass spectrometrymetabolite identificationsmall molecule identificationcontestmetabolomicsnon-target identificationunknown identification
spellingShingle Steffen Neumann
Emma L. Schymanski
CASMI: And the Winner is . . .
Metabolites
mass spectrometry
metabolite identification
small molecule identification
contest
metabolomics
non-target identification
unknown identification
title CASMI: And the Winner is . . .
title_full CASMI: And the Winner is . . .
title_fullStr CASMI: And the Winner is . . .
title_full_unstemmed CASMI: And the Winner is . . .
title_short CASMI: And the Winner is . . .
title_sort casmi and the winner is
topic mass spectrometry
metabolite identification
small molecule identification
contest
metabolomics
non-target identification
unknown identification
url http://www.mdpi.com/2218-1989/3/2/412
work_keys_str_mv AT steffenneumann casmiandthewinneris
AT emmalschymanski casmiandthewinneris