Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.

BACKGROUND: Central to the design of a randomised controlled trial (RCT) is a calculation of the number of participants needed. This is typically achieved by specifying a target difference, which enables the trial to identify a difference of a particular magnitude should one exist. Seven methods hav...

Бүрэн тодорхойлолт

Номзүйн дэлгэрэнгүй
Үндсэн зохиолчид: Cook, J, Hislop, J, Altman, D, Briggs, A, Fayers, P, Norrie, J, Ramsay, C, Harvey, I, Vale, L
Формат: Journal article
Хэл сонгох:English
Хэвлэсэн: SAGE Publications 2014
_version_ 1826306430918983680
author Cook, J
Hislop, J
Altman, D
Briggs, A
Fayers, P
Norrie, J
Ramsay, C
Harvey, I
Vale, L
author_facet Cook, J
Hislop, J
Altman, D
Briggs, A
Fayers, P
Norrie, J
Ramsay, C
Harvey, I
Vale, L
author_sort Cook, J
collection OXFORD
description BACKGROUND: Central to the design of a randomised controlled trial (RCT) is a calculation of the number of participants needed. This is typically achieved by specifying a target difference, which enables the trial to identify a difference of a particular magnitude should one exist. Seven methods have been proposed for formally determining what the target difference should be. However, in practice, it may be driven by convenience or some other informal basis. It is unclear how aware the trialist community is of these formal methods or whether they are used. PURPOSE: To determine current practice regarding the specification of the target difference by surveying trialists. METHODS: Two surveys were conducted: (1) Members of the Society for Clinical Trials (SCT): participants were invited to complete an online survey through the society's email distribution list. Respondents were asked about their awareness, use of, and willingness to recommend methods; (2) Leading UK- and Ireland-based trialists: the survey was sent to UK Clinical Research Collaboration registered Clinical Trials Units, Medical Research Council UK Hubs for Trial Methodology Research, and the Research Design Services of the National Institute for Health Research. This survey also included questions about the most recent trial developed by the respondent's group. RESULTS: Survey 1: Of the 1182 members on the SCT membership email distribution list, 180 responses were received (15%). Awareness of methods ranged from 69 (38%) for health economic methods to 162 (90%) for pilot study. Willingness to recommend among those who had used a particular method ranged from 56% for the opinion-seeking method to 89% for the review of evidence-base method. Survey 2: Of the 61 surveys sent out, 34 (56%) responses were received. Awareness of methods ranged from 33 (97%) for the review of evidence-base and pilot methods to 14 (41%) for the distribution method. The highest level of willingness to recommend among users was for the anchor method (87%). Based upon the most recent trial, the target difference was usually one viewed as important by a stakeholder group, mostly also viewed as a realistic difference given the interventions under evaluation, and sometimes one that led to an achievable sample size. LIMITATIONS: The response rates achieved were relatively low despite the surveys being short, well presented, and having utilised reminders. CONCLUSION: Substantial variations in practice exist with awareness, use, and willingness to recommend methods varying substantially. The findings support the view that sample size calculation is a more complex process than would appear to be the case from trial reports and protocols. Guidance on approaches for sample size estimation may increase both awareness and use of appropriate formal methods.
first_indexed 2024-03-07T06:47:52Z
format Journal article
id oxford-uuid:fb77a09b-db0f-4ca4-af95-1fbae296ec1e
institution University of Oxford
language English
last_indexed 2024-03-07T06:47:52Z
publishDate 2014
publisher SAGE Publications
record_format dspace
spelling oxford-uuid:fb77a09b-db0f-4ca4-af95-1fbae296ec1e2022-03-27T13:14:13ZUse of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:fb77a09b-db0f-4ca4-af95-1fbae296ec1eEnglishSymplectic Elements at OxfordSAGE Publications2014Cook, JHislop, JAltman, DBriggs, AFayers, PNorrie, JRamsay, CHarvey, IVale, LBACKGROUND: Central to the design of a randomised controlled trial (RCT) is a calculation of the number of participants needed. This is typically achieved by specifying a target difference, which enables the trial to identify a difference of a particular magnitude should one exist. Seven methods have been proposed for formally determining what the target difference should be. However, in practice, it may be driven by convenience or some other informal basis. It is unclear how aware the trialist community is of these formal methods or whether they are used. PURPOSE: To determine current practice regarding the specification of the target difference by surveying trialists. METHODS: Two surveys were conducted: (1) Members of the Society for Clinical Trials (SCT): participants were invited to complete an online survey through the society's email distribution list. Respondents were asked about their awareness, use of, and willingness to recommend methods; (2) Leading UK- and Ireland-based trialists: the survey was sent to UK Clinical Research Collaboration registered Clinical Trials Units, Medical Research Council UK Hubs for Trial Methodology Research, and the Research Design Services of the National Institute for Health Research. This survey also included questions about the most recent trial developed by the respondent's group. RESULTS: Survey 1: Of the 1182 members on the SCT membership email distribution list, 180 responses were received (15%). Awareness of methods ranged from 69 (38%) for health economic methods to 162 (90%) for pilot study. Willingness to recommend among those who had used a particular method ranged from 56% for the opinion-seeking method to 89% for the review of evidence-base method. Survey 2: Of the 61 surveys sent out, 34 (56%) responses were received. Awareness of methods ranged from 33 (97%) for the review of evidence-base and pilot methods to 14 (41%) for the distribution method. The highest level of willingness to recommend among users was for the anchor method (87%). Based upon the most recent trial, the target difference was usually one viewed as important by a stakeholder group, mostly also viewed as a realistic difference given the interventions under evaluation, and sometimes one that led to an achievable sample size. LIMITATIONS: The response rates achieved were relatively low despite the surveys being short, well presented, and having utilised reminders. CONCLUSION: Substantial variations in practice exist with awareness, use, and willingness to recommend methods varying substantially. The findings support the view that sample size calculation is a more complex process than would appear to be the case from trial reports and protocols. Guidance on approaches for sample size estimation may increase both awareness and use of appropriate formal methods.
spellingShingle Cook, J
Hislop, J
Altman, D
Briggs, A
Fayers, P
Norrie, J
Ramsay, C
Harvey, I
Vale, L
Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.
title Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.
title_full Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.
title_fullStr Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.
title_full_unstemmed Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.
title_short Use of methods for specifying the target difference in randomised controlled trial sample size calculations: Two surveys of trialists' practice.
title_sort use of methods for specifying the target difference in randomised controlled trial sample size calculations two surveys of trialists practice
work_keys_str_mv AT cookj useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT hislopj useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT altmand useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT briggsa useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT fayersp useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT norriej useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT ramsayc useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT harveyi useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice
AT valel useofmethodsforspecifyingthetargetdifferenceinrandomisedcontrolledtrialsamplesizecalculationstwosurveysoftrialistspractice