Meta-analysis, Simpson's paradox, and the number needed to treat

<p style="text-align:justify;"> <b>Background:</b> There is debate concerning methods for calculating numbers needed to treat (NNT) from results of systematic reviews.<br/><br/> <b>Methods:</b> We investigate the susceptibility to bias for alterna...

Full description

Bibliographic Details
Main Authors: Altman, D, Deeks, J
Format: Journal article
Language:English
Published: BioMed Central 2002
_version_ 1797069461051670528
author Altman, D
Deeks, J
author_facet Altman, D
Deeks, J
author_sort Altman, D
collection OXFORD
description <p style="text-align:justify;"> <b>Background:</b> There is debate concerning methods for calculating numbers needed to treat (NNT) from results of systematic reviews.<br/><br/> <b>Methods:</b> We investigate the susceptibility to bias for alternative methods for calculating NNTs through illustrative examples and mathematical theory.<br/><br/> <b>Results:</b> Two competing methods have been recommended: one method involves calculating the NNT from meta-analytical estimates, the other by treating the data as if it all arose from a single trial. The 'treat-as-one-trial' method was found to be susceptible to bias when there were imbalances between groups within one or more trials in the meta-analysis (Simpson's paradox). Calculation of NNTs from meta-analytical estimates is not prone to the same bias. The method of calculating the NNT from a meta-analysis depends on the treatment effect used. When relative measures of treatment effect are used the estimates of NNTs can be tailored to the level of baseline risk.<br/><br/> <b>Conclusions:</b> The treat-as-one-trial method of calculating numbers needed to treat should not be used as it is prone to bias. Analysts should always report the method they use to compute estimates to enable readers to judge whether it is appropriate. </p>
first_indexed 2024-03-06T22:24:48Z
format Journal article
id oxford-uuid:564cc679-61a7-4baf-a620-4af3211ce4f4
institution University of Oxford
language English
last_indexed 2024-03-06T22:24:48Z
publishDate 2002
publisher BioMed Central
record_format dspace
spelling oxford-uuid:564cc679-61a7-4baf-a620-4af3211ce4f42022-03-26T16:49:31ZMeta-analysis, Simpson's paradox, and the number needed to treatJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:564cc679-61a7-4baf-a620-4af3211ce4f4EnglishSymplectic Elements at OxfordBioMed Central2002Altman, DDeeks, J <p style="text-align:justify;"> <b>Background:</b> There is debate concerning methods for calculating numbers needed to treat (NNT) from results of systematic reviews.<br/><br/> <b>Methods:</b> We investigate the susceptibility to bias for alternative methods for calculating NNTs through illustrative examples and mathematical theory.<br/><br/> <b>Results:</b> Two competing methods have been recommended: one method involves calculating the NNT from meta-analytical estimates, the other by treating the data as if it all arose from a single trial. The 'treat-as-one-trial' method was found to be susceptible to bias when there were imbalances between groups within one or more trials in the meta-analysis (Simpson's paradox). Calculation of NNTs from meta-analytical estimates is not prone to the same bias. The method of calculating the NNT from a meta-analysis depends on the treatment effect used. When relative measures of treatment effect are used the estimates of NNTs can be tailored to the level of baseline risk.<br/><br/> <b>Conclusions:</b> The treat-as-one-trial method of calculating numbers needed to treat should not be used as it is prone to bias. Analysts should always report the method they use to compute estimates to enable readers to judge whether it is appropriate. </p>
spellingShingle Altman, D
Deeks, J
Meta-analysis, Simpson's paradox, and the number needed to treat
title Meta-analysis, Simpson's paradox, and the number needed to treat
title_full Meta-analysis, Simpson's paradox, and the number needed to treat
title_fullStr Meta-analysis, Simpson's paradox, and the number needed to treat
title_full_unstemmed Meta-analysis, Simpson's paradox, and the number needed to treat
title_short Meta-analysis, Simpson's paradox, and the number needed to treat
title_sort meta analysis simpson s paradox and the number needed to treat
work_keys_str_mv AT altmand metaanalysissimpsonsparadoxandthenumberneededtotreat
AT deeksj metaanalysissimpsonsparadoxandthenumberneededtotreat