Simulation methods to estimate design power: an overview for applied research

<p>Abstract</p> <p>Background</p> <p>Estimating the required sample size and statistical power for a study is an integral part of study design. For standard designs, power equations provide an efficient solution to the problem, but they are unavailable for many complex...

Full description

Bibliographic Details
Main Authors: Colford John M, Hogan Daniel R, Arnold Benjamin F, Hubbard Alan E
Format: Article
Language:English
Published: BMC 2011-06-01
Series:BMC Medical Research Methodology
Subjects:
Online Access:http://www.biomedcentral.com/1471-2288/11/94
_version_ 1818345750004760576
author Colford John M
Hogan Daniel R
Arnold Benjamin F
Hubbard Alan E
author_facet Colford John M
Hogan Daniel R
Arnold Benjamin F
Hubbard Alan E
author_sort Colford John M
collection DOAJ
description <p>Abstract</p> <p>Background</p> <p>Estimating the required sample size and statistical power for a study is an integral part of study design. For standard designs, power equations provide an efficient solution to the problem, but they are unavailable for many complex study designs that arise in practice. For such complex study designs, computer simulation is a useful alternative for estimating study power. Although this approach is well known among statisticians, in our experience many epidemiologists and social scientists are unfamiliar with the technique. This article aims to address this knowledge gap.</p> <p>Methods</p> <p>We review an approach to estimate study power for individual- or cluster-randomized designs using computer simulation. This flexible approach arises naturally from the model used to derive conventional power equations, but extends those methods to accommodate arbitrarily complex designs. The method is universally applicable to a broad range of designs and outcomes, and we present the material in a way that is approachable for quantitative, applied researchers. We illustrate the method using two examples (one simple, one complex) based on sanitation and nutritional interventions to improve child growth.</p> <p>Results</p> <p>We first show how simulation reproduces conventional power estimates for simple randomized designs over a broad range of sample scenarios to familiarize the reader with the approach. We then demonstrate how to extend the simulation approach to more complex designs. Finally, we discuss extensions to the examples in the article, and provide computer code to efficiently run the example simulations in both R and Stata.</p> <p>Conclusions</p> <p>Simulation methods offer a flexible option to estimate statistical power for standard and non-traditional study designs and parameters of interest. The approach we have described is universally applicable for evaluating study designs used in epidemiologic and social science research.</p>
first_indexed 2024-12-13T17:07:20Z
format Article
id doaj.art-f80d61fa427242198d9f3e65c6f2a498
institution Directory Open Access Journal
issn 1471-2288
language English
last_indexed 2024-12-13T17:07:20Z
publishDate 2011-06-01
publisher BMC
record_format Article
series BMC Medical Research Methodology
spelling doaj.art-f80d61fa427242198d9f3e65c6f2a4982022-12-21T23:37:39ZengBMCBMC Medical Research Methodology1471-22882011-06-011119410.1186/1471-2288-11-94Simulation methods to estimate design power: an overview for applied researchColford John MHogan Daniel RArnold Benjamin FHubbard Alan E<p>Abstract</p> <p>Background</p> <p>Estimating the required sample size and statistical power for a study is an integral part of study design. For standard designs, power equations provide an efficient solution to the problem, but they are unavailable for many complex study designs that arise in practice. For such complex study designs, computer simulation is a useful alternative for estimating study power. Although this approach is well known among statisticians, in our experience many epidemiologists and social scientists are unfamiliar with the technique. This article aims to address this knowledge gap.</p> <p>Methods</p> <p>We review an approach to estimate study power for individual- or cluster-randomized designs using computer simulation. This flexible approach arises naturally from the model used to derive conventional power equations, but extends those methods to accommodate arbitrarily complex designs. The method is universally applicable to a broad range of designs and outcomes, and we present the material in a way that is approachable for quantitative, applied researchers. We illustrate the method using two examples (one simple, one complex) based on sanitation and nutritional interventions to improve child growth.</p> <p>Results</p> <p>We first show how simulation reproduces conventional power estimates for simple randomized designs over a broad range of sample scenarios to familiarize the reader with the approach. We then demonstrate how to extend the simulation approach to more complex designs. Finally, we discuss extensions to the examples in the article, and provide computer code to efficiently run the example simulations in both R and Stata.</p> <p>Conclusions</p> <p>Simulation methods offer a flexible option to estimate statistical power for standard and non-traditional study designs and parameters of interest. The approach we have described is universally applicable for evaluating study designs used in epidemiologic and social science research.</p>http://www.biomedcentral.com/1471-2288/11/94Computer SimulationPowerResearch DesignSample Size
spellingShingle Colford John M
Hogan Daniel R
Arnold Benjamin F
Hubbard Alan E
Simulation methods to estimate design power: an overview for applied research
BMC Medical Research Methodology
Computer Simulation
Power
Research Design
Sample Size
title Simulation methods to estimate design power: an overview for applied research
title_full Simulation methods to estimate design power: an overview for applied research
title_fullStr Simulation methods to estimate design power: an overview for applied research
title_full_unstemmed Simulation methods to estimate design power: an overview for applied research
title_short Simulation methods to estimate design power: an overview for applied research
title_sort simulation methods to estimate design power an overview for applied research
topic Computer Simulation
Power
Research Design
Sample Size
url http://www.biomedcentral.com/1471-2288/11/94
work_keys_str_mv AT colfordjohnm simulationmethodstoestimatedesignpoweranoverviewforappliedresearch
AT hogandanielr simulationmethodstoestimatedesignpoweranoverviewforappliedresearch
AT arnoldbenjaminf simulationmethodstoestimatedesignpoweranoverviewforappliedresearch
AT hubbardalane simulationmethodstoestimatedesignpoweranoverviewforappliedresearch