Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study.
OBJECTIVE: To examine whether the association of inadequate or unclear allocation concealment and lack of blinding with biased estimates of intervention effects varies with the nature of the intervention or outcome. DESIGN: Combined analysis of data from three meta-epidemiological studies based on...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
2008
|
| _version_ | 1797085824082247680 |
|---|---|
| author | Wood, L Egger, M Gluud, L Schulz, K Jüni, P Altman, D Gluud, C Martin, R Wood, A Sterne, J |
| author_facet | Wood, L Egger, M Gluud, L Schulz, K Jüni, P Altman, D Gluud, C Martin, R Wood, A Sterne, J |
| author_sort | Wood, L |
| collection | OXFORD |
| description | OBJECTIVE: To examine whether the association of inadequate or unclear allocation concealment and lack of blinding with biased estimates of intervention effects varies with the nature of the intervention or outcome. DESIGN: Combined analysis of data from three meta-epidemiological studies based on collections of meta-analyses. DATA SOURCES: 146 meta-analyses including 1346 trials examining a wide range of interventions and outcomes. MAIN OUTCOME MEASURES: Ratios of odds ratios quantifying the degree of bias associated with inadequate or unclear allocation concealment, and lack of blinding, for trials with different types of intervention and outcome. A ratio of odds ratios <1 implies that inadequately concealed or non-blinded trials exaggerate intervention effect estimates. RESULTS: In trials with subjective outcomes effect estimates were exaggerated when there was inadequate or unclear allocation concealment (ratio of odds ratios 0.69 (95% CI 0.59 to 0.82)) or lack of blinding (0.75 (0.61 to 0.93)). In contrast, there was little evidence of bias in trials with objective outcomes: ratios of odds ratios 0.91 (0.80 to 1.03) for inadequate or unclear allocation concealment and 1.01 (0.92 to 1.10) for lack of blinding. There was little evidence for a difference between trials of drug and non-drug interventions. Except for trials with all cause mortality as the outcome, the magnitude of bias varied between meta-analyses. CONCLUSIONS: The average bias associated with defects in the conduct of randomised trials varies with the type of outcome. Systematic reviewers should routinely assess the risk of bias in the results of trials, and should report meta-analyses restricted to trials at low risk of bias either as the primary analysis or in conjunction with less restrictive analyses. |
| first_indexed | 2024-03-07T02:13:26Z |
| format | Journal article |
| id | oxford-uuid:a1699044-1294-4117-802d-b74311e17788 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T02:13:26Z |
| publishDate | 2008 |
| record_format | dspace |
| spelling | oxford-uuid:a1699044-1294-4117-802d-b74311e177882022-03-27T02:13:05ZEmpirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:a1699044-1294-4117-802d-b74311e17788EnglishSymplectic Elements at Oxford2008Wood, LEgger, MGluud, LSchulz, KJüni, PAltman, DGluud, CMartin, RWood, ASterne, J OBJECTIVE: To examine whether the association of inadequate or unclear allocation concealment and lack of blinding with biased estimates of intervention effects varies with the nature of the intervention or outcome. DESIGN: Combined analysis of data from three meta-epidemiological studies based on collections of meta-analyses. DATA SOURCES: 146 meta-analyses including 1346 trials examining a wide range of interventions and outcomes. MAIN OUTCOME MEASURES: Ratios of odds ratios quantifying the degree of bias associated with inadequate or unclear allocation concealment, and lack of blinding, for trials with different types of intervention and outcome. A ratio of odds ratios <1 implies that inadequately concealed or non-blinded trials exaggerate intervention effect estimates. RESULTS: In trials with subjective outcomes effect estimates were exaggerated when there was inadequate or unclear allocation concealment (ratio of odds ratios 0.69 (95% CI 0.59 to 0.82)) or lack of blinding (0.75 (0.61 to 0.93)). In contrast, there was little evidence of bias in trials with objective outcomes: ratios of odds ratios 0.91 (0.80 to 1.03) for inadequate or unclear allocation concealment and 1.01 (0.92 to 1.10) for lack of blinding. There was little evidence for a difference between trials of drug and non-drug interventions. Except for trials with all cause mortality as the outcome, the magnitude of bias varied between meta-analyses. CONCLUSIONS: The average bias associated with defects in the conduct of randomised trials varies with the type of outcome. Systematic reviewers should routinely assess the risk of bias in the results of trials, and should report meta-analyses restricted to trials at low risk of bias either as the primary analysis or in conjunction with less restrictive analyses. |
| spellingShingle | Wood, L Egger, M Gluud, L Schulz, K Jüni, P Altman, D Gluud, C Martin, R Wood, A Sterne, J Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. |
| title | Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. |
| title_full | Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. |
| title_fullStr | Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. |
| title_full_unstemmed | Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. |
| title_short | Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: meta-epidemiological study. |
| title_sort | empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes meta epidemiological study |
| work_keys_str_mv | AT woodl empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT eggerm empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT gluudl empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT schulzk empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT junip empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT altmand empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT gluudc empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT martinr empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT wooda empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy AT sternej empiricalevidenceofbiasintreatmenteffectestimatesincontrolledtrialswithdifferentinterventionsandoutcomesmetaepidemiologicalstudy |