How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level
Abstract Background The number of clusters in a cluster randomized trial is often low. It is therefore likely random assignment of clusters to treatment conditions results in covariate imbalance. There are no studies that quantify the consequences of covariate imbalance in cluster randomized trials...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2016-07-01
|
| Series: | BMC Medical Research Methodology |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12874-016-0182-7 |
| _version_ | 1819260807077167104 |
|---|---|
| author | Mirjam Moerbeek Sander van Schie |
| author_facet | Mirjam Moerbeek Sander van Schie |
| author_sort | Mirjam Moerbeek |
| collection | DOAJ |
| description | Abstract Background The number of clusters in a cluster randomized trial is often low. It is therefore likely random assignment of clusters to treatment conditions results in covariate imbalance. There are no studies that quantify the consequences of covariate imbalance in cluster randomized trials on parameter and standard error bias and on power to detect treatment effects. Methods The consequences of covariance imbalance in unadjusted and adjusted linear mixed models are investigated by means of a simulation study. The factors in this study are the degree of imbalance, the covariate effect size, the cluster size and the intraclass correlation coefficient. The covariate is binary and measured at the cluster level; the outcome is continuous and measured at the individual level. Results The results show covariate imbalance results in negligible parameter bias and small standard error bias in adjusted linear mixed models. Ignoring the possibility of covariate imbalance while calculating the sample size at the cluster level may result in a loss in power of at most 25 % in the adjusted linear mixed model. The results are more severe for the unadjusted linear mixed model: parameter biases up to 100 % and standard error biases up to 200 % may be observed. Power levels based on the unadjusted linear mixed model are often too low. The consequences are most severe for large clusters and/or small intraclass correlation coefficients since then the required number of clusters to achieve a desired power level is smallest. Conclusions The possibility of covariate imbalance should be taken into account while calculating the sample size of a cluster randomized trial. Otherwise more sophisticated methods to randomize clusters to treatments should be used, such as stratification or balance algorithms. All relevant covariates should be carefully identified, be actually measured and included in the statistical model to avoid severe levels of parameter and standard error bias and insufficient power levels. |
| first_indexed | 2024-12-23T19:31:46Z |
| format | Article |
| id | doaj.art-a4894899107b4bf7a7dbe508f081bb9e |
| institution | Directory Open Access Journal |
| issn | 1471-2288 |
| language | English |
| last_indexed | 2024-12-23T19:31:46Z |
| publishDate | 2016-07-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Research Methodology |
| spelling | doaj.art-a4894899107b4bf7a7dbe508f081bb9e2022-12-21T17:33:54ZengBMCBMC Medical Research Methodology1471-22882016-07-0116111010.1186/s12874-016-0182-7How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster levelMirjam Moerbeek0Sander van Schie1Department of Methodology and Statistics, Utrecht UniversityDepartment of Methodology and Statistics, Utrecht UniversityAbstract Background The number of clusters in a cluster randomized trial is often low. It is therefore likely random assignment of clusters to treatment conditions results in covariate imbalance. There are no studies that quantify the consequences of covariate imbalance in cluster randomized trials on parameter and standard error bias and on power to detect treatment effects. Methods The consequences of covariance imbalance in unadjusted and adjusted linear mixed models are investigated by means of a simulation study. The factors in this study are the degree of imbalance, the covariate effect size, the cluster size and the intraclass correlation coefficient. The covariate is binary and measured at the cluster level; the outcome is continuous and measured at the individual level. Results The results show covariate imbalance results in negligible parameter bias and small standard error bias in adjusted linear mixed models. Ignoring the possibility of covariate imbalance while calculating the sample size at the cluster level may result in a loss in power of at most 25 % in the adjusted linear mixed model. The results are more severe for the unadjusted linear mixed model: parameter biases up to 100 % and standard error biases up to 200 % may be observed. Power levels based on the unadjusted linear mixed model are often too low. The consequences are most severe for large clusters and/or small intraclass correlation coefficients since then the required number of clusters to achieve a desired power level is smallest. Conclusions The possibility of covariate imbalance should be taken into account while calculating the sample size of a cluster randomized trial. Otherwise more sophisticated methods to randomize clusters to treatments should be used, such as stratification or balance algorithms. All relevant covariates should be carefully identified, be actually measured and included in the statistical model to avoid severe levels of parameter and standard error bias and insufficient power levels.http://link.springer.com/article/10.1186/s12874-016-0182-7Cluster randomizationCovariate imbalanceUnadjusted linear mixed modelAdjusted linear mixed modelSimulation study |
| spellingShingle | Mirjam Moerbeek Sander van Schie How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level BMC Medical Research Methodology Cluster randomization Covariate imbalance Unadjusted linear mixed model Adjusted linear mixed model Simulation study |
| title | How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level |
| title_full | How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level |
| title_fullStr | How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level |
| title_full_unstemmed | How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level |
| title_short | How large are the consequences of covariate imbalance in cluster randomized trials: a simulation study with a continuous outcome and a binary covariate at the cluster level |
| title_sort | how large are the consequences of covariate imbalance in cluster randomized trials a simulation study with a continuous outcome and a binary covariate at the cluster level |
| topic | Cluster randomization Covariate imbalance Unadjusted linear mixed model Adjusted linear mixed model Simulation study |
| url | http://link.springer.com/article/10.1186/s12874-016-0182-7 |
| work_keys_str_mv | AT mirjammoerbeek howlargearetheconsequencesofcovariateimbalanceinclusterrandomizedtrialsasimulationstudywithacontinuousoutcomeandabinarycovariateattheclusterlevel AT sandervanschie howlargearetheconsequencesofcovariateimbalanceinclusterrandomizedtrialsasimulationstudywithacontinuousoutcomeandabinarycovariateattheclusterlevel |