The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]

A central tenet in support of research reproducibility is the ability to uniquely identify research resources, i.e., reagents, tools, and materials that are used to perform experiments. However, current reporting practices for research resources are insufficient to allow humans and algorithms to ide...

Full description

Bibliographic Details
Main Authors: Anita Bandrowski, Matthew Brush, Jeffery S. Grethe, Melissa A. Haendel, David N. Kennedy, Sean Hill, Patrick R. Hof, Maryann E. Martone, Maaike Pols, Serena Tan, Nicole Washington, Elena Zudilova-Seinstra, Nicole Vasilevsky, Resource Identification Initiative Members are listed here: https://www.force11.org/node/4463/members
Format: Article
Language:English
Published: F1000 Research Ltd 2015-05-01
Series:F1000Research
Subjects:
Online Access:http://f1000research.com/articles/4-134/v1
_version_ 1818513272965431296
author Anita Bandrowski
Matthew Brush
Jeffery S. Grethe
Melissa A. Haendel
David N. Kennedy
Sean Hill
Patrick R. Hof
Maryann E. Martone
Maaike Pols
Serena Tan
Nicole Washington
Elena Zudilova-Seinstra
Nicole Vasilevsky
Resource Identification Initiative Members are listed here: https://www.force11.org/node/4463/members
author_facet Anita Bandrowski
Matthew Brush
Jeffery S. Grethe
Melissa A. Haendel
David N. Kennedy
Sean Hill
Patrick R. Hof
Maryann E. Martone
Maaike Pols
Serena Tan
Nicole Washington
Elena Zudilova-Seinstra
Nicole Vasilevsky
Resource Identification Initiative Members are listed here: https://www.force11.org/node/4463/members
author_sort Anita Bandrowski
collection DOAJ
description A central tenet in support of research reproducibility is the ability to uniquely identify research resources, i.e., reagents, tools, and materials that are used to perform experiments. However, current reporting practices for research resources are insufficient to allow humans and algorithms to identify the exact resources that are reported or answer basic questions such as “What other studies used resource X?” To address this issue, the Resource Identification Initiative was launched as a pilot project to improve the reporting standards for research resources in the methods sections of papers and thereby improve identifiability and reproducibility. The pilot engaged over 25 biomedical journal editors from most major publishers, as well as scientists and funding officials. Authors were asked to include Research Resource Identifiers (RRIDs) in their manuscripts prior to publication for three resource types: antibodies, model organisms, and tools (including software and databases). RRIDs represent accession numbers assigned by an authoritative database, e.g., the model organism databases, for each type of resource. To make it easier for authors to obtain RRIDs, resources were aggregated from the appropriate databases and their RRIDs made available in a central web portal (www.scicrunch.org/resources). RRIDs meet three key criteria: they are machine readable, free to generate and access, and are consistent across publishers and journals. The pilot was launched in February of 2014 and over 300 papers have appeared that report RRIDs. The number of journals participating has expanded from the original 25 to more than 40. Here, we present an overview of the pilot project and its outcomes to date. We show that authors are generally accurate in performing the task of identifying resources and supportive of the goals of the project. We also show that identifiability of the resources pre- and post-pilot showed a dramatic improvement for all three resource types, suggesting that the project has had a significant impact on reproducibility relating to research resources.
first_indexed 2024-12-10T23:58:54Z
format Article
id doaj.art-2af489d9790f43da89e3cd8cc5102baf
institution Directory Open Access Journal
issn 2046-1402
language English
last_indexed 2024-12-10T23:58:54Z
publishDate 2015-05-01
publisher F1000 Research Ltd
record_format Article
series F1000Research
spelling doaj.art-2af489d9790f43da89e3cd8cc5102baf2022-12-22T01:28:31ZengF1000 Research LtdF1000Research2046-14022015-05-01410.12688/f1000research.6555.17039The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]Anita Bandrowski0Matthew Brush1Jeffery S. Grethe2Melissa A. Haendel3David N. Kennedy4Sean Hill5Patrick R. Hof6Maryann E. Martone7Maaike Pols8Serena Tan9Nicole Washington10Elena Zudilova-Seinstra11Nicole Vasilevsky12Resource Identification Initiative Members are listed here: https://www.force11.org/node/4463/membersCenter for Research in Biological Systems, UCSD, la Jolla, CA, 92093, USADepartment of Medical Informatics & Clinical Epidemiology, OHSU, Portland, Oregon, 97239, USACenter for Research in Biological Systems, UCSD, la Jolla, CA, 92093, USADepartment of Medical Informatics & Clinical Epidemiology, OHSU, Portland, Oregon, 97239, USADepartment of Psychiatry, University of Massachusetts Medical School, Worcester, MA, 01605, USAKarolinska Institutet, Stockholm, 171 77, SwedenLeon and Norma Hess Center for Science and Medicine, Icahn School of Medicine at Mount Sinai, New York, NY, 10029, USACenter for Research in Biological Systems, UCSD, la Jolla, CA, 92093, USAScientific Outreach, Faculty of 1000 Ltd, London, W1T 4LB, UKJohn Wiley and Sons, Hoboken, NJ, 07030, USALawrence Berkeley National Laboratory, Lawrence Berkeley National Laboratory, Berkeley, CA, 94720, USAElsevier, Amsterdam, 1043 NX, NetherlandsDepartment of Medical Informatics & Clinical Epidemiology, OHSU, Portland, Oregon, 97239, USAA central tenet in support of research reproducibility is the ability to uniquely identify research resources, i.e., reagents, tools, and materials that are used to perform experiments. However, current reporting practices for research resources are insufficient to allow humans and algorithms to identify the exact resources that are reported or answer basic questions such as “What other studies used resource X?” To address this issue, the Resource Identification Initiative was launched as a pilot project to improve the reporting standards for research resources in the methods sections of papers and thereby improve identifiability and reproducibility. The pilot engaged over 25 biomedical journal editors from most major publishers, as well as scientists and funding officials. Authors were asked to include Research Resource Identifiers (RRIDs) in their manuscripts prior to publication for three resource types: antibodies, model organisms, and tools (including software and databases). RRIDs represent accession numbers assigned by an authoritative database, e.g., the model organism databases, for each type of resource. To make it easier for authors to obtain RRIDs, resources were aggregated from the appropriate databases and their RRIDs made available in a central web portal (www.scicrunch.org/resources). RRIDs meet three key criteria: they are machine readable, free to generate and access, and are consistent across publishers and journals. The pilot was launched in February of 2014 and over 300 papers have appeared that report RRIDs. The number of journals participating has expanded from the original 25 to more than 40. Here, we present an overview of the pilot project and its outcomes to date. We show that authors are generally accurate in performing the task of identifying resources and supportive of the goals of the project. We also show that identifiability of the resources pre- and post-pilot showed a dramatic improvement for all three resource types, suggesting that the project has had a significant impact on reproducibility relating to research resources.http://f1000research.com/articles/4-134/v1Data Sharing
spellingShingle Anita Bandrowski
Matthew Brush
Jeffery S. Grethe
Melissa A. Haendel
David N. Kennedy
Sean Hill
Patrick R. Hof
Maryann E. Martone
Maaike Pols
Serena Tan
Nicole Washington
Elena Zudilova-Seinstra
Nicole Vasilevsky
Resource Identification Initiative Members are listed here: https://www.force11.org/node/4463/members
The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]
F1000Research
Data Sharing
title The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]
title_full The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]
title_fullStr The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]
title_full_unstemmed The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]
title_short The Resource Identification Initiative: A cultural shift in publishing [v1; ref status: indexed, http://f1000r.es/5fj]
title_sort resource identification initiative a cultural shift in publishing v1 ref status indexed http f1000r es 5fj
topic Data Sharing
url http://f1000research.com/articles/4-134/v1
work_keys_str_mv AT anitabandrowski theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT matthewbrush theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT jefferysgrethe theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT melissaahaendel theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT davidnkennedy theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT seanhill theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT patrickrhof theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT maryannemartone theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT maaikepols theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT serenatan theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT nicolewashington theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT elenazudilovaseinstra theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT nicolevasilevsky theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT resourceidentificationinitiativemembersarelistedherehttpswwwforce11orgnode4463members theresourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT anitabandrowski resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT matthewbrush resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT jefferysgrethe resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT melissaahaendel resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT davidnkennedy resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT seanhill resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT patrickrhof resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT maryannemartone resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT maaikepols resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT serenatan resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT nicolewashington resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT elenazudilovaseinstra resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT nicolevasilevsky resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj
AT resourceidentificationinitiativemembersarelistedherehttpswwwforce11orgnode4463members resourceidentificationinitiativeaculturalshiftinpublishingv1refstatusindexedhttpf1000res5fj