Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis

Propensity score (PS) analysis allows an unbiased estimate of treatment effects but assumes that all confounders are measured. We assessed the impact of omitting confounders from a PS analysis on clinical decision making.We conducted Monte Carlo simulations on hypothetical observational studies base...

Description complète

Détails bibliographiques
Auteurs principaux: Nguyen, T, Collins, G, Spence, J, Fontaine, C, Daurès, J, Devereaux, P, Landais, P, Le Manach, Y
Format: Journal article
Langue:English
Publié: Elsevier 2017
_version_ 1826280594757124096
author Nguyen, T
Collins, G
Spence, J
Fontaine, C
Daurès, J
Devereaux, P
Landais, P
Le Manach, Y
author_facet Nguyen, T
Collins, G
Spence, J
Fontaine, C
Daurès, J
Devereaux, P
Landais, P
Le Manach, Y
author_sort Nguyen, T
collection OXFORD
description Propensity score (PS) analysis allows an unbiased estimate of treatment effects but assumes that all confounders are measured. We assessed the impact of omitting confounders from a PS analysis on clinical decision making.We conducted Monte Carlo simulations on hypothetical observational studies based on virtual populations and on the population from a large randomized trial (CRASH-2). In both series of simulations, PS analysis was conducted with all confounders and with omitted confounders, which were defined to have different strengths of association with the outcome and treatment exposure. After inverse probability of treatment weighting, we calculated the absolute risk differences and numbers needed to treat (NNT).In both series of simulations, omitting a confounder that was moderately associated with the outcome and exposure led to negligible bias on the NNT scale. The bias induced by omitting strongly positive confounding variables remained less than 15 patients to treat. Major bias and reversed effects were found only when omitting highly prevalent, strongly negative confounders that were similarly associated with the outcome and exposure with odds ratios greater than 4.00 (or <0.25). This omission was accompanied by a substantial decrease in analysis power.The omission of strongly negative confounding variables from a PS analysis can lead to incorrect clinical decision making. However, omitting these variables also decreases the analysis power, which may prevent the reporting of significant but misleading effects.
first_indexed 2024-03-07T00:16:02Z
format Journal article
id oxford-uuid:7adc31fe-8cb1-4f24-a198-fc9218cc9297
institution University of Oxford
language English
last_indexed 2024-03-07T00:16:02Z
publishDate 2017
publisher Elsevier
record_format dspace
spelling oxford-uuid:7adc31fe-8cb1-4f24-a198-fc9218cc92972022-03-26T20:46:53ZMagnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysisJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:7adc31fe-8cb1-4f24-a198-fc9218cc9297EnglishSymplectic Elements at OxfordElsevier2017Nguyen, TCollins, GSpence, JFontaine, CDaurès, JDevereaux, PLandais, PLe Manach, YPropensity score (PS) analysis allows an unbiased estimate of treatment effects but assumes that all confounders are measured. We assessed the impact of omitting confounders from a PS analysis on clinical decision making.We conducted Monte Carlo simulations on hypothetical observational studies based on virtual populations and on the population from a large randomized trial (CRASH-2). In both series of simulations, PS analysis was conducted with all confounders and with omitted confounders, which were defined to have different strengths of association with the outcome and treatment exposure. After inverse probability of treatment weighting, we calculated the absolute risk differences and numbers needed to treat (NNT).In both series of simulations, omitting a confounder that was moderately associated with the outcome and exposure led to negligible bias on the NNT scale. The bias induced by omitting strongly positive confounding variables remained less than 15 patients to treat. Major bias and reversed effects were found only when omitting highly prevalent, strongly negative confounders that were similarly associated with the outcome and exposure with odds ratios greater than 4.00 (or <0.25). This omission was accompanied by a substantial decrease in analysis power.The omission of strongly negative confounding variables from a PS analysis can lead to incorrect clinical decision making. However, omitting these variables also decreases the analysis power, which may prevent the reporting of significant but misleading effects.
spellingShingle Nguyen, T
Collins, G
Spence, J
Fontaine, C
Daurès, J
Devereaux, P
Landais, P
Le Manach, Y
Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
title Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
title_full Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
title_fullStr Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
title_full_unstemmed Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
title_short Magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
title_sort magnitude and direction of missing confounders had different consequences on treatment effect estimation in propensity score analysis
work_keys_str_mv AT nguyent magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT collinsg magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT spencej magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT fontainec magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT dauresj magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT devereauxp magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT landaisp magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis
AT lemanachy magnitudeanddirectionofmissingconfoundershaddifferentconsequencesontreatmenteffectestimationinpropensityscoreanalysis