Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study
<br/><strong>Objective:</strong> To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. <br/><strong>Design:</strong> Retrospective before and after study. <br/><...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
BMJ Publishing Group
2014
|
| _version_ | 1824458556593668096 |
|---|---|
| author | Hopewell, S Collins, G Boutron, I Yu, L Cook, J Shanyinde, M Wharton, R Shamseer, L Altman, D |
| author_facet | Hopewell, S Collins, G Boutron, I Yu, L Cook, J Shanyinde, M Wharton, R Shamseer, L Altman, D |
| author_sort | Hopewell, S |
| collection | OXFORD |
| description | <br/><strong>Objective:</strong> To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. <br/><strong>Design:</strong> Retrospective before and after study. <br/><strong>Setting:</strong> BioMed Central series medical journals. <br/><strong>Sample:</strong> 93 primary reports of randomised trials published in <em>BMC</em>-series medical journals in 2012. <strong>Main outcome measures:</strong> Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. <br/><strong>Results:</strong> Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript--for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). <br/><strong>Conclusion:</strong> Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. |
| first_indexed | 2024-03-06T18:44:24Z |
| format | Journal article |
| id | oxford-uuid:0e02d2af-0737-4e32-8aa6-12fd328ca999 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2025-02-19T04:27:46Z |
| publishDate | 2014 |
| publisher | BMJ Publishing Group |
| record_format | dspace |
| spelling | oxford-uuid:0e02d2af-0737-4e32-8aa6-12fd328ca9992024-12-14T20:03:39ZImpact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after studyJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:0e02d2af-0737-4e32-8aa6-12fd328ca999EnglishSymplectic Elements at OxfordBMJ Publishing Group2014Hopewell, SCollins, GBoutron, IYu, LCook, JShanyinde, MWharton, RShamseer, LAltman, D<br/><strong>Objective:</strong> To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. <br/><strong>Design:</strong> Retrospective before and after study. <br/><strong>Setting:</strong> BioMed Central series medical journals. <br/><strong>Sample:</strong> 93 primary reports of randomised trials published in <em>BMC</em>-series medical journals in 2012. <strong>Main outcome measures:</strong> Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. <br/><strong>Results:</strong> Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript--for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). <br/><strong>Conclusion:</strong> Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. |
| spellingShingle | Hopewell, S Collins, G Boutron, I Yu, L Cook, J Shanyinde, M Wharton, R Shamseer, L Altman, D Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study |
| title | Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study |
| title_full | Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study |
| title_fullStr | Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study |
| title_full_unstemmed | Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study |
| title_short | Impact of peer review on reports of randomised trials published in open peer review journals : retrospective before and after study |
| title_sort | impact of peer review on reports of randomised trials published in open peer review journals retrospective before and after study |
| work_keys_str_mv | AT hopewells impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT collinsg impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT boutroni impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT yul impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT cookj impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT shanyindem impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT whartonr impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT shamseerl impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy AT altmand impactofpeerreviewonreportsofrandomisedtrialspublishedinopenpeerreviewjournalsretrospectivebeforeandafterstudy |