CASMI: And the Winner is . . .
The Critical Assessment of Small Molecule Identification (CASMI) Contest was founded in 2012 to provide scientists with a common open dataset to evaluate their identification methods. In this review, we summarize the submissions, evaluate procedures and discuss the results. We received five submissi...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2013-05-01
|
Series: | Metabolites |
Subjects: | |
Online Access: | http://www.mdpi.com/2218-1989/3/2/412 |
_version_ | 1828399648338870272 |
---|---|
author | Steffen Neumann Emma L. Schymanski |
author_facet | Steffen Neumann Emma L. Schymanski |
author_sort | Steffen Neumann |
collection | DOAJ |
description | The Critical Assessment of Small Molecule Identification (CASMI) Contest was founded in 2012 to provide scientists with a common open dataset to evaluate their identification methods. In this review, we summarize the submissions, evaluate procedures and discuss the results. We received five submissions (three external, two internal) for LC–MS Category 1 (best molecular formula) and six submissions (three external, three internal) for LC–MS Category 2 (best molecular structure). No external submissions were received for the GC–MS Categories 3 and 4. The team of Dunn et al. from Birmingham had the most answers in the 1st place for Category 1, while Category 2 was won by H. Oberacher. Despite the low number of participants, the external and internal submissions cover a broad range of identification strategies, including expert knowledge, database searching, automated methods and structure generation. The results of Category 1 show that complementing automated strategies with (manual) expert knowledge was the most successful approach, while no automated method could compete with the power of spectral searching for Category 2—if the challenge was present in a spectral library. Every participant topped at least one challenge, showing that different approaches are still necessary for interpretation diversity. |
first_indexed | 2024-12-10T09:20:27Z |
format | Article |
id | doaj.art-a59e8f97242c43e8a5fa0e7f58cc5613 |
institution | Directory Open Access Journal |
issn | 2218-1989 |
language | English |
last_indexed | 2024-12-10T09:20:27Z |
publishDate | 2013-05-01 |
publisher | MDPI AG |
record_format | Article |
series | Metabolites |
spelling | doaj.art-a59e8f97242c43e8a5fa0e7f58cc56132022-12-22T01:54:43ZengMDPI AGMetabolites2218-19892013-05-013241243910.3390/metabo3020412CASMI: And the Winner is . . .Steffen NeumannEmma L. SchymanskiThe Critical Assessment of Small Molecule Identification (CASMI) Contest was founded in 2012 to provide scientists with a common open dataset to evaluate their identification methods. In this review, we summarize the submissions, evaluate procedures and discuss the results. We received five submissions (three external, two internal) for LC–MS Category 1 (best molecular formula) and six submissions (three external, three internal) for LC–MS Category 2 (best molecular structure). No external submissions were received for the GC–MS Categories 3 and 4. The team of Dunn et al. from Birmingham had the most answers in the 1st place for Category 1, while Category 2 was won by H. Oberacher. Despite the low number of participants, the external and internal submissions cover a broad range of identification strategies, including expert knowledge, database searching, automated methods and structure generation. The results of Category 1 show that complementing automated strategies with (manual) expert knowledge was the most successful approach, while no automated method could compete with the power of spectral searching for Category 2—if the challenge was present in a spectral library. Every participant topped at least one challenge, showing that different approaches are still necessary for interpretation diversity.http://www.mdpi.com/2218-1989/3/2/412mass spectrometrymetabolite identificationsmall molecule identificationcontestmetabolomicsnon-target identificationunknown identification |
spellingShingle | Steffen Neumann Emma L. Schymanski CASMI: And the Winner is . . . Metabolites mass spectrometry metabolite identification small molecule identification contest metabolomics non-target identification unknown identification |
title | CASMI: And the Winner is . . . |
title_full | CASMI: And the Winner is . . . |
title_fullStr | CASMI: And the Winner is . . . |
title_full_unstemmed | CASMI: And the Winner is . . . |
title_short | CASMI: And the Winner is . . . |
title_sort | casmi and the winner is |
topic | mass spectrometry metabolite identification small molecule identification contest metabolomics non-target identification unknown identification |
url | http://www.mdpi.com/2218-1989/3/2/412 |
work_keys_str_mv | AT steffenneumann casmiandthewinneris AT emmalschymanski casmiandthewinneris |