Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme

<strong>Background<br></strong> Randomised controlled trials (‘trials’) are susceptible to poor participant recruitment and retention. Studies Within A Trial (SWATs) are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However,...

Full description

Bibliographic Details
Main Authors: Parker, A, Arundel, C, Clark, L, Coleman, E, Doherty, L, Hewitt , CE, Beard, D, Bower, P, Cooper, C, Culliford, L, Devane, D, Emsley, R, Eldridge, S, Galvin, S, Gillies, K, Montgomery, A, Sutton, CJ, Treweek, S, Torgerson, DJ
Format: Journal article
Language:English
Published: National Institute for Health and Care Research 2024
_version_ 1826312583813005312
author Parker, A
Arundel, C
Clark, L
Coleman, E
Doherty, L
Hewitt , CE
Beard, D
Bower, P
Cooper, C
Culliford, L
Devane, D
Emsley, R
Eldridge, S
Galvin, S
Gillies, K
Montgomery, A
Sutton, CJ
Treweek, S
Torgerson, DJ
author_facet Parker, A
Arundel, C
Clark, L
Coleman, E
Doherty, L
Hewitt , CE
Beard, D
Bower, P
Cooper, C
Culliford, L
Devane, D
Emsley, R
Eldridge, S
Galvin, S
Gillies, K
Montgomery, A
Sutton, CJ
Treweek, S
Torgerson, DJ
author_sort Parker, A
collection OXFORD
description <strong>Background<br></strong> Randomised controlled trials (‘trials’) are susceptible to poor participant recruitment and retention. Studies Within A Trial (SWATs) are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However, relatively few of these have been conducted. <br><strong>Aims<br></strong> PROMoting THE USE of Studies Within A Trial (PROMETHEUS) aimed to facilitate at least 25 SWATs evaluating recruitment or retention strategies. We share our experience of delivering the PROMETHEUS programme, and the lessons learnt for undertaking randomised SWATs. <br><strong>Design<br></strong> A network of 10 Clinical Trials Units (CTUs) and one primary care research centre committed to conducting randomised controlled SWATs of recruitment and/or retention strategies was established. Promising recruitment and retention strategies were identified from various sources including Cochrane systematic reviews, the SWAT Repository, and existing prioritisation exercises, which were reviewed by patient and public (PPI) members to create an initial priority list of seven recruitment and eight retention interventions. Host trial teams could apply for funding and receive support from the PROMETHEUS team to undertake SWATs. We also tested the feasibility of undertaking coordinated SWATs, across multiple host trials simultaneously. <br><strong>Setting<br></strong> CTU-based trials recruiting or following up participants in any setting in the UK were eligible. Participants<br></strong> CTU-based teams undertaking trials in any clinical context in the UK. <br><strong>Interventions<br></strong> Funding of up to £5,000 and support from the PROMETHEUS team to design, implement, and report SWATs. <br><strong>Main outcome measures<br></strong> Number of host trials funded. <br><strong> Results<br></strong> 42 SWATs were funded (31 host trials), across 12 CTUs. The mean cost of a SWAT was £3,535. Twelve SWATs tested the same strategy across multiple host trials using a coordinated SWAT design, and four used a factorial design. Two recruitment and five retention strategies were evaluated in more than one host trial. PROMETHEUS will add 18% more SWATs to the Cochrane systematic review of recruitment strategies, and 79% more SWATs to the Cochrane review of retention strategies. For retention, we found that pre-notifying participants by card, letter or email before sending questionnaires was effective, as was the use of pens, and sending personalised text messages to improve questionnaire response. We highlight key lessons learnt to guide others planning SWATs, including involving PPI partners; prioritising and selecting strategies to evaluate and elements to consider when designing a SWAT; obtaining governance approvals; implementing SWATs, including individual and coordinated SWATs, and; reporting SWATs. <br><strong>Limitations<br></strong> The COVID-19 pandemic negatively impacted five SWATs, being either delayed (n=2) or prematurely terminated (n=3). <br><strong>Conclusions<br></strong> PROMETHEUS significantly increased the evidence base for recruitment and retention strategies. When provided with both funding and practical support, host trial teams successfully implemented SWATs. <br><strong>Future research<br></strong> Future research should identify and target gaps in the evidence base, including widening SWAT uptake, undertaking more complex SWATs, and translating SWAT evidence into practice. <br><strong>Study registration<br></strong> All SWATs had to be registered with the Northern Ireland Network for Trials Methodology Research SWAT Repository. <br><strong>Funding details<br></strong> This project was funded by the Medical Research Council (MR/R013748/1) and National Institute for Health Research as part of the MRC–NIHR Methodology Research programme.
first_indexed 2024-03-07T08:10:01Z
format Journal article
id oxford-uuid:b703a1da-5d6b-4247-a180-84904585a9c4
institution University of Oxford
language English
last_indexed 2024-04-09T03:56:18Z
publishDate 2024
publisher National Institute for Health and Care Research
record_format dspace
spelling oxford-uuid:b703a1da-5d6b-4247-a180-84904585a9c42024-03-18T12:59:06ZUndertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programmeJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:b703a1da-5d6b-4247-a180-84904585a9c4EnglishSymplectic ElementsNational Institute for Health and Care Research2024Parker, AArundel, CClark, LColeman, EDoherty, LHewitt , CEBeard, DBower, PCooper, CCulliford, LDevane, DEmsley, REldridge, SGalvin, SGillies, KMontgomery, ASutton, CJTreweek, STorgerson, DJ<strong>Background<br></strong> Randomised controlled trials (‘trials’) are susceptible to poor participant recruitment and retention. Studies Within A Trial (SWATs) are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However, relatively few of these have been conducted. <br><strong>Aims<br></strong> PROMoting THE USE of Studies Within A Trial (PROMETHEUS) aimed to facilitate at least 25 SWATs evaluating recruitment or retention strategies. We share our experience of delivering the PROMETHEUS programme, and the lessons learnt for undertaking randomised SWATs. <br><strong>Design<br></strong> A network of 10 Clinical Trials Units (CTUs) and one primary care research centre committed to conducting randomised controlled SWATs of recruitment and/or retention strategies was established. Promising recruitment and retention strategies were identified from various sources including Cochrane systematic reviews, the SWAT Repository, and existing prioritisation exercises, which were reviewed by patient and public (PPI) members to create an initial priority list of seven recruitment and eight retention interventions. Host trial teams could apply for funding and receive support from the PROMETHEUS team to undertake SWATs. We also tested the feasibility of undertaking coordinated SWATs, across multiple host trials simultaneously. <br><strong>Setting<br></strong> CTU-based trials recruiting or following up participants in any setting in the UK were eligible. Participants<br></strong> CTU-based teams undertaking trials in any clinical context in the UK. <br><strong>Interventions<br></strong> Funding of up to £5,000 and support from the PROMETHEUS team to design, implement, and report SWATs. <br><strong>Main outcome measures<br></strong> Number of host trials funded. <br><strong> Results<br></strong> 42 SWATs were funded (31 host trials), across 12 CTUs. The mean cost of a SWAT was £3,535. Twelve SWATs tested the same strategy across multiple host trials using a coordinated SWAT design, and four used a factorial design. Two recruitment and five retention strategies were evaluated in more than one host trial. PROMETHEUS will add 18% more SWATs to the Cochrane systematic review of recruitment strategies, and 79% more SWATs to the Cochrane review of retention strategies. For retention, we found that pre-notifying participants by card, letter or email before sending questionnaires was effective, as was the use of pens, and sending personalised text messages to improve questionnaire response. We highlight key lessons learnt to guide others planning SWATs, including involving PPI partners; prioritising and selecting strategies to evaluate and elements to consider when designing a SWAT; obtaining governance approvals; implementing SWATs, including individual and coordinated SWATs, and; reporting SWATs. <br><strong>Limitations<br></strong> The COVID-19 pandemic negatively impacted five SWATs, being either delayed (n=2) or prematurely terminated (n=3). <br><strong>Conclusions<br></strong> PROMETHEUS significantly increased the evidence base for recruitment and retention strategies. When provided with both funding and practical support, host trial teams successfully implemented SWATs. <br><strong>Future research<br></strong> Future research should identify and target gaps in the evidence base, including widening SWAT uptake, undertaking more complex SWATs, and translating SWAT evidence into practice. <br><strong>Study registration<br></strong> All SWATs had to be registered with the Northern Ireland Network for Trials Methodology Research SWAT Repository. <br><strong>Funding details<br></strong> This project was funded by the Medical Research Council (MR/R013748/1) and National Institute for Health Research as part of the MRC–NIHR Methodology Research programme.
spellingShingle Parker, A
Arundel, C
Clark, L
Coleman, E
Doherty, L
Hewitt , CE
Beard, D
Bower, P
Cooper, C
Culliford, L
Devane, D
Emsley, R
Eldridge, S
Galvin, S
Gillies, K
Montgomery, A
Sutton, CJ
Treweek, S
Torgerson, DJ
Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme
title Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme
title_full Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme
title_fullStr Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme
title_full_unstemmed Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme
title_short Undertaking studies within a trial to evaluate recruitment and retention strategies for RCTs: lessons learnt from the PROMETHEUS research programme
title_sort undertaking studies within a trial to evaluate recruitment and retention strategies for rcts lessons learnt from the prometheus research programme
work_keys_str_mv AT parkera undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT arundelc undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT clarkl undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT colemane undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT dohertyl undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT hewittce undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT beardd undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT bowerp undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT cooperc undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT cullifordl undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT devaned undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT emsleyr undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT eldridges undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT galvins undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT gilliesk undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT montgomerya undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT suttoncj undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT treweeks undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme
AT torgersondj undertakingstudieswithinatrialtoevaluaterecruitmentandretentionstrategiesforrctslessonslearntfromtheprometheusresearchprogramme