The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.

OBJECTIVE: To estimate the degree of scatter of reports of randomised trials and systematic reviews, and how the scatter differs among medical specialties and subspecialties. DESIGN: Cross sectional analysis. DATA SOURCE: PubMed for all disease relevant randomised trials and systematic reviews publ...

Full description

Bibliographic Details
Main Authors: Hoffmann, T, Erueti, C, Thorning, S, Glasziou, P
Format: Journal article
Language:English
Published: 2012
_version_ 1797072868252581888
author Hoffmann, T
Erueti, C
Thorning, S
Glasziou, P
author_facet Hoffmann, T
Erueti, C
Thorning, S
Glasziou, P
author_sort Hoffmann, T
collection OXFORD
description OBJECTIVE: To estimate the degree of scatter of reports of randomised trials and systematic reviews, and how the scatter differs among medical specialties and subspecialties. DESIGN: Cross sectional analysis. DATA SOURCE: PubMed for all disease relevant randomised trials and systematic reviews published in 2009. STUDY SELECTION: Randomised trials and systematic reviews of the nine diseases or disorders with the highest burden of disease, and the broader category of disease to which each belonged. RESULTS: The scatter across journals varied considerably among specialties and subspecialties: otolaryngology had the least scatter (363 trials across 167 journals) and neurology the most (2770 trials across 896 journals). In only three subspecialties (lung cancer, chronic obstructive pulmonary disease, hearing loss) were 10 or fewer journals needed to locate 50% of trials. The scatter was less for systematic reviews: hearing loss had the least scatter (10 reviews across nine journals) and cancer the most (670 reviews across 279 journals). For some specialties and subspecialties the papers were concentrated in specialty journals; whereas for others, few of the top 10 journals were a specialty journal for that area. Generally, little overlap occurred between the top 10 journals publishing trials and those publishing systematic reviews. The number of journals required to find all trials or reviews was highly correlated (r = 0.97) with the number of papers for each specialty/subspecialty. CONCLUSIONS: Publication rates of speciality relevant trials vary widely, from one to seven trials per day, and are scattered across hundreds of general and specialty journals. Although systematic reviews reduce the extent of scatter, they are still widely scattered and mostly in different journals to those of randomised trials. Personal subscriptions to journals, which are insufficient for keeping up to date with knowledge, need to be supplemented by other methods such as journal scanning services or systems that cover sufficient journals and filter articles for quality and relevance. Few current systems seem adequate.
first_indexed 2024-03-06T23:13:52Z
format Journal article
id oxford-uuid:6671afad-b725-4e92-9b15-62ab387746d9
institution University of Oxford
language English
last_indexed 2024-03-06T23:13:52Z
publishDate 2012
record_format dspace
spelling oxford-uuid:6671afad-b725-4e92-9b15-62ab387746d92022-03-26T18:31:51ZThe scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:6671afad-b725-4e92-9b15-62ab387746d9EnglishSymplectic Elements at Oxford2012Hoffmann, TErueti, CThorning, SGlasziou, P OBJECTIVE: To estimate the degree of scatter of reports of randomised trials and systematic reviews, and how the scatter differs among medical specialties and subspecialties. DESIGN: Cross sectional analysis. DATA SOURCE: PubMed for all disease relevant randomised trials and systematic reviews published in 2009. STUDY SELECTION: Randomised trials and systematic reviews of the nine diseases or disorders with the highest burden of disease, and the broader category of disease to which each belonged. RESULTS: The scatter across journals varied considerably among specialties and subspecialties: otolaryngology had the least scatter (363 trials across 167 journals) and neurology the most (2770 trials across 896 journals). In only three subspecialties (lung cancer, chronic obstructive pulmonary disease, hearing loss) were 10 or fewer journals needed to locate 50% of trials. The scatter was less for systematic reviews: hearing loss had the least scatter (10 reviews across nine journals) and cancer the most (670 reviews across 279 journals). For some specialties and subspecialties the papers were concentrated in specialty journals; whereas for others, few of the top 10 journals were a specialty journal for that area. Generally, little overlap occurred between the top 10 journals publishing trials and those publishing systematic reviews. The number of journals required to find all trials or reviews was highly correlated (r = 0.97) with the number of papers for each specialty/subspecialty. CONCLUSIONS: Publication rates of speciality relevant trials vary widely, from one to seven trials per day, and are scattered across hundreds of general and specialty journals. Although systematic reviews reduce the extent of scatter, they are still widely scattered and mostly in different journals to those of randomised trials. Personal subscriptions to journals, which are insufficient for keeping up to date with knowledge, need to be supplemented by other methods such as journal scanning services or systems that cover sufficient journals and filter articles for quality and relevance. Few current systems seem adequate.
spellingShingle Hoffmann, T
Erueti, C
Thorning, S
Glasziou, P
The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.
title The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.
title_full The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.
title_fullStr The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.
title_full_unstemmed The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.
title_short The scatter of research: cross sectional comparison of randomised trials and systematic reviews across specialties.
title_sort scatter of research cross sectional comparison of randomised trials and systematic reviews across specialties
work_keys_str_mv AT hoffmannt thescatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT eruetic thescatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT thornings thescatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT glaszioup thescatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT hoffmannt scatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT eruetic scatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT thornings scatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties
AT glaszioup scatterofresearchcrosssectionalcomparisonofrandomisedtrialsandsystematicreviewsacrossspecialties