Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)

<p>Abstract</p> <p>Background</p> <p>Cluster randomized trials (CRTs) are increasingly used to assess the effectiveness of interventions to improve health outcomes or prevent diseases. However, the efficiency and consistency of using different analytical methods in the...

Full description

Bibliographic Details
Main Authors: Dolovich Lisa, Chambers Larry, Kaczorowski Janusz, Thabane Lehana, Ma Jinhui, Karwalajtys Tina, Levitt Cheryl
Format: Article
Language:English
Published: BMC 2009-06-01
Series:BMC Medical Research Methodology
Online Access:http://www.biomedcentral.com/1471-2288/9/37
_version_ 1828491306470473728
author Dolovich Lisa
Chambers Larry
Kaczorowski Janusz
Thabane Lehana
Ma Jinhui
Karwalajtys Tina
Levitt Cheryl
author_facet Dolovich Lisa
Chambers Larry
Kaczorowski Janusz
Thabane Lehana
Ma Jinhui
Karwalajtys Tina
Levitt Cheryl
author_sort Dolovich Lisa
collection DOAJ
description <p>Abstract</p> <p>Background</p> <p>Cluster randomized trials (CRTs) are increasingly used to assess the effectiveness of interventions to improve health outcomes or prevent diseases. However, the efficiency and consistency of using different analytical methods in the analysis of binary outcome have received little attention. We described and compared various statistical approaches in the analysis of CRTs using the Community Hypertension Assessment Trial (CHAT) as an example. The CHAT study was a cluster randomized controlled trial aimed at investigating the effectiveness of pharmacy-based blood pressure clinics led by peer health educators, with feedback to family physicians (CHAT intervention) against Usual Practice model (Control), on the monitoring and management of BP among older adults.</p> <p>Methods</p> <p>We compared three cluster-level and six individual-level statistical analysis methods in the analysis of binary outcomes from the CHAT study. The three cluster-level analysis methods were: i) un-weighted linear regression, ii) weighted linear regression, and iii) random-effects meta-regression. The six individual level analysis methods were: i) standard logistic regression, ii) robust standard errors approach, iii) generalized estimating equations, iv) random-effects meta-analytic approach, v) random-effects logistic regression, and vi) Bayesian random-effects regression. We also investigated the robustness of the estimates after the adjustment for the cluster and individual level covariates.</p> <p>Results</p> <p>Among all the statistical methods assessed, the Bayesian random-effects logistic regression method yielded the widest 95% interval estimate for the odds ratio and consequently led to the most conservative conclusion. However, the results remained robust under all methods – showing sufficient evidence in support of the hypothesis of no effect for the CHAT intervention against Usual Practice control model for management of blood pressure among seniors in primary care. The individual-level standard logistic regression is the least appropriate method in the analysis of CRTs because it ignores the correlation of the outcomes for the individuals within the same cluster.</p> <p>Conclusion</p> <p>We used data from the CHAT trial to compare different methods for analysing data from CRTs. Using different methods to analyse CRTs provides a good approach to assess the sensitivity of the results to enhance interpretation.</p>
first_indexed 2024-12-11T11:00:03Z
format Article
id doaj.art-dac7b998ad1a463794fff5cf93c9b303
institution Directory Open Access Journal
issn 1471-2288
language English
last_indexed 2024-12-11T11:00:03Z
publishDate 2009-06-01
publisher BMC
record_format Article
series BMC Medical Research Methodology
spelling doaj.art-dac7b998ad1a463794fff5cf93c9b3032022-12-22T01:09:54ZengBMCBMC Medical Research Methodology1471-22882009-06-01913710.1186/1471-2288-9-37Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)Dolovich LisaChambers LarryKaczorowski JanuszThabane LehanaMa JinhuiKarwalajtys TinaLevitt Cheryl<p>Abstract</p> <p>Background</p> <p>Cluster randomized trials (CRTs) are increasingly used to assess the effectiveness of interventions to improve health outcomes or prevent diseases. However, the efficiency and consistency of using different analytical methods in the analysis of binary outcome have received little attention. We described and compared various statistical approaches in the analysis of CRTs using the Community Hypertension Assessment Trial (CHAT) as an example. The CHAT study was a cluster randomized controlled trial aimed at investigating the effectiveness of pharmacy-based blood pressure clinics led by peer health educators, with feedback to family physicians (CHAT intervention) against Usual Practice model (Control), on the monitoring and management of BP among older adults.</p> <p>Methods</p> <p>We compared three cluster-level and six individual-level statistical analysis methods in the analysis of binary outcomes from the CHAT study. The three cluster-level analysis methods were: i) un-weighted linear regression, ii) weighted linear regression, and iii) random-effects meta-regression. The six individual level analysis methods were: i) standard logistic regression, ii) robust standard errors approach, iii) generalized estimating equations, iv) random-effects meta-analytic approach, v) random-effects logistic regression, and vi) Bayesian random-effects regression. We also investigated the robustness of the estimates after the adjustment for the cluster and individual level covariates.</p> <p>Results</p> <p>Among all the statistical methods assessed, the Bayesian random-effects logistic regression method yielded the widest 95% interval estimate for the odds ratio and consequently led to the most conservative conclusion. However, the results remained robust under all methods – showing sufficient evidence in support of the hypothesis of no effect for the CHAT intervention against Usual Practice control model for management of blood pressure among seniors in primary care. The individual-level standard logistic regression is the least appropriate method in the analysis of CRTs because it ignores the correlation of the outcomes for the individuals within the same cluster.</p> <p>Conclusion</p> <p>We used data from the CHAT trial to compare different methods for analysing data from CRTs. Using different methods to analyse CRTs provides a good approach to assess the sensitivity of the results to enhance interpretation.</p>http://www.biomedcentral.com/1471-2288/9/37
spellingShingle Dolovich Lisa
Chambers Larry
Kaczorowski Janusz
Thabane Lehana
Ma Jinhui
Karwalajtys Tina
Levitt Cheryl
Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
BMC Medical Research Methodology
title Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
title_full Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
title_fullStr Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
title_full_unstemmed Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
title_short Comparison of Bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome: The Community Hypertension Assessment Trial (CHAT)
title_sort comparison of bayesian and classical methods in the analysis of cluster randomized controlled trials with a binary outcome the community hypertension assessment trial chat
url http://www.biomedcentral.com/1471-2288/9/37
work_keys_str_mv AT dolovichlisa comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat
AT chamberslarry comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat
AT kaczorowskijanusz comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat
AT thabanelehana comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat
AT majinhui comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat
AT karwalajtystina comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat
AT levittcheryl comparisonofbayesianandclassicalmethodsintheanalysisofclusterrandomizedcontrolledtrialswithabinaryoutcomethecommunityhypertensionassessmenttrialchat