A reliability-generalization study of journal peer reviews: a multilevel meta-analysis of inter-rater reliability and its determinants.

This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined as the extent to which two or more independent reviews of the same scientific document agree.Altogether, 70 reliability coefficients (Cohen's Kappa, intra-class correlation...

Full description

Bibliographic Details
Main Authors: Lutz Bornmann, Rüdiger Mutz, Hans-Dieter Daniel
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2010-12-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC3001856?pdf=render