An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]

Background: There are currently numerous innovations in peer review and quality assurance in scholarly publishing. The Research on Research Institute conducted a programme of co-produced projects investigating these innovations. This literature review was part of one such project ‘Experiments in pee...

Full description

Bibliographic Details
Main Authors: Helen Buckley Woods, Wolfgang Kaltenbrunner, Stephen Pinfield, Johanna Brumberg, Ludo Waltman
Format: Article
Language:English
Published: Wellcome 2023-01-01
Series:Wellcome Open Research
Subjects:
Online Access:https://wellcomeopenresearch.org/articles/7-82/v2
_version_ 1811160227445211136
author Helen Buckley Woods
Wolfgang Kaltenbrunner
Stephen Pinfield
Johanna Brumberg
Ludo Waltman
author_facet Helen Buckley Woods
Wolfgang Kaltenbrunner
Stephen Pinfield
Johanna Brumberg
Ludo Waltman
author_sort Helen Buckley Woods
collection DOAJ
description Background: There are currently numerous innovations in peer review and quality assurance in scholarly publishing. The Research on Research Institute conducted a programme of co-produced projects investigating these innovations. This literature review was part of one such project ‘Experiments in peer review’ which created an inventory and framework of peer review innovations. The aim of this literature review was to aid the development of the inventory by identifying innovations in the external peer review of journal manuscripts reported in the scholarly literature and by providing a summary of the different approaches. This did not include interventions in editorial processes. Methods: This review of reviews is based on data identified from Web of Science and Scopus limited from 2010 to 2021. A total of 291 records were screened, with six review articles chosen for the focus of the literature review. Items were selected that described approaches to innovating peer review or illustrated examples.   Results: The overview of innovations are drawn from six review articles. The innovations are divided into three high-level categories: approaches to peer review, reviewer focussed initiatives and technology to support peer review with sub-categories of results presented in tabular form and summarised. A summary of all innovations found is also presented. Conclusions: From a simple synthesis of the review authors’ conclusions, three key messages are presented: observations on current practice; authors’ views on the implications of innovations in peer review; and calls for action in peer review research and practice.
first_indexed 2024-04-10T05:54:05Z
format Article
id doaj.art-7c5cfd15974c4c05bb59a2bf6541fef8
institution Directory Open Access Journal
issn 2398-502X
language English
last_indexed 2024-04-10T05:54:05Z
publishDate 2023-01-01
publisher Wellcome
record_format Article
series Wellcome Open Research
spelling doaj.art-7c5cfd15974c4c05bb59a2bf6541fef82023-03-04T01:00:00ZengWellcomeWellcome Open Research2398-502X2023-01-01720892An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]Helen Buckley Woods0Wolfgang Kaltenbrunner1Stephen Pinfield2https://orcid.org/0000-0003-4696-764XJohanna Brumberg3https://orcid.org/0000-0001-9403-4591Ludo Waltman4Research on Research Institute and Information School, The University of Sheffield, Sheffield, South Yorkshire, S10 2TN, UKResearch on Research Institute and Centre for Science and Technology Studies, Leiden University, Leiden, The NetherlandsResearch on Research Institute and Information School, The University of Sheffield, Sheffield, South Yorkshire, S10 2TN, UKVolkswagen Stiftung, Hannover, GermanyResearch on Research Institute and Centre for Science and Technology Studies, Leiden University, Leiden, The NetherlandsBackground: There are currently numerous innovations in peer review and quality assurance in scholarly publishing. The Research on Research Institute conducted a programme of co-produced projects investigating these innovations. This literature review was part of one such project ‘Experiments in peer review’ which created an inventory and framework of peer review innovations. The aim of this literature review was to aid the development of the inventory by identifying innovations in the external peer review of journal manuscripts reported in the scholarly literature and by providing a summary of the different approaches. This did not include interventions in editorial processes. Methods: This review of reviews is based on data identified from Web of Science and Scopus limited from 2010 to 2021. A total of 291 records were screened, with six review articles chosen for the focus of the literature review. Items were selected that described approaches to innovating peer review or illustrated examples.   Results: The overview of innovations are drawn from six review articles. The innovations are divided into three high-level categories: approaches to peer review, reviewer focussed initiatives and technology to support peer review with sub-categories of results presented in tabular form and summarised. A summary of all innovations found is also presented. Conclusions: From a simple synthesis of the review authors’ conclusions, three key messages are presented: observations on current practice; authors’ views on the implications of innovations in peer review; and calls for action in peer review research and practice.https://wellcomeopenresearch.org/articles/7-82/v2peer review scholarly publishing innovation meta-summary review of reviewseng
spellingShingle Helen Buckley Woods
Wolfgang Kaltenbrunner
Stephen Pinfield
Johanna Brumberg
Ludo Waltman
An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]
Wellcome Open Research
peer review
scholarly publishing
innovation
meta-summary
review of reviews
eng
title An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]
title_full An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]
title_fullStr An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]
title_full_unstemmed An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]
title_short An overview of innovations in the external peer review of journal manuscripts. [version 2; peer review: 2 approved, 1 not approved]
title_sort overview of innovations in the external peer review of journal manuscripts version 2 peer review 2 approved 1 not approved
topic peer review
scholarly publishing
innovation
meta-summary
review of reviews
eng
url https://wellcomeopenresearch.org/articles/7-82/v2
work_keys_str_mv AT helenbuckleywoods anoverviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT wolfgangkaltenbrunner anoverviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT stephenpinfield anoverviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT johannabrumberg anoverviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT ludowaltman anoverviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT helenbuckleywoods overviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT wolfgangkaltenbrunner overviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT stephenpinfield overviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT johannabrumberg overviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved
AT ludowaltman overviewofinnovationsintheexternalpeerreviewofjournalmanuscriptsversion2peerreview2approved1notapproved