Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study
BackgroundPublic health research studies often rely on population-based participation and draw on various recruitment methods to establish samples. Increasingly, researchers are turning to web-based recruitment tools. However, few studies detail traditional and web-based recr...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2021-11-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2021/11/e21142 |
| _version_ | 1797735557984419840 |
|---|---|
| author | Rania Wasfi Zoe Poirier Stephens Meridith Sones Karen Laberee Caitlin Pugh Daniel Fuller Meghan Winters Yan Kestens |
| author_facet | Rania Wasfi Zoe Poirier Stephens Meridith Sones Karen Laberee Caitlin Pugh Daniel Fuller Meghan Winters Yan Kestens |
| author_sort | Rania Wasfi |
| collection | DOAJ |
| description |
BackgroundPublic health research studies often rely on population-based participation and draw on various recruitment methods to establish samples. Increasingly, researchers are turning to web-based recruitment tools. However, few studies detail traditional and web-based recruitment efforts in terms of costs and potential biases.
ObjectiveThis study aims to report on and evaluate the cost-effectiveness, time effectiveness, and sociodemographic representation of diverse recruitment methods used to enroll participants in 3 cities of the Interventions, Research, and Action in Cities Team (INTERACT) study, a cohort study conducted in Canadian cities.
MethodsOver 2017 and 2018 in Vancouver, Saskatoon, and Montreal, the INTERACT study used the following recruitment methods: mailed letters, social media (including sponsored Facebook advertisements), news media, partner communications, snowball recruitment, in-person recruitment, and posters. Participation in the study involved answering web-based questionnaires (at minimum), activating a smartphone app to share sensor data, and wearing a device for mobility and physical activity monitoring. We describe sociodemographic characteristics by the recruitment method and analyze performance indicators, including cost, completion rate, and time effectiveness. Effectiveness included calculating cost per completer (ie, a participant who completed at least one questionnaire), the completion rate of a health questionnaire, and the delay between completion of eligibility and health questionnaires. Cost included producing materials (ie, printing costs), transmitting recruitment messages (ie, mailing list rental, postage, and sponsored Facebook posts charges), and staff time. In Montreal, the largest INTERACT sample, we modeled the number of daily recruits through generalized linear models accounting for the distributed lagged effects of recruitment campaigns.
ResultsOverall, 1791 participants were recruited from 3 cities and completed at least one questionnaire: 318 in Vancouver, 315 in Saskatoon, and 1158 in Montreal. In all cities, most participants chose to participate fully (questionnaires, apps, and devices). The costs associated with a completed participant varied across recruitment methods and by city. Facebook advertisements generated the most recruits (n=687), at a cost of CAD $15.04 (US $11.57; including staff time) per completer. Mailed letters were the costliest, at CAD $108.30 (US $83.3) per completer but served to reach older participants. All methods resulted in a gender imbalance, with women participating more, specifically with social media. Partner newsletters resulted in the participation of younger adults and were cost-efficient (CAD $5.16 [US $3.97] per completer). A generalized linear model for daily Montreal recruitment identified 2-day lag effects on most recruitment methods, except for the snowball campaign (4 days), letters (15 days), and reminder cards (5 days).
ConclusionsThis study presents comprehensive data on the costs, effectiveness, and bias of population recruitment in a cohort study in 3 Canadian cities. More comprehensive documentation and reporting of recruitment efforts across studies are needed to improve our capacity to conduct inclusive intervention research. |
| first_indexed | 2024-03-12T13:00:48Z |
| format | Article |
| id | doaj.art-c3fa43e783e24b139533ef9062f66fd1 |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-03-12T13:00:48Z |
| publishDate | 2021-11-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-c3fa43e783e24b139533ef9062f66fd12023-08-28T19:46:14ZengJMIR PublicationsJournal of Medical Internet Research1438-88712021-11-012311e2114210.2196/21142Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort StudyRania Wasfihttps://orcid.org/0000-0002-8605-1540Zoe Poirier Stephenshttps://orcid.org/0000-0002-3918-1414Meridith Soneshttps://orcid.org/0000-0002-8128-4599Karen Labereehttps://orcid.org/0000-0003-4886-6121Caitlin Pughhttps://orcid.org/0000-0002-0553-7136Daniel Fullerhttps://orcid.org/0000-0002-2015-2955Meghan Wintershttps://orcid.org/0000-0001-9932-0255Yan Kestenshttps://orcid.org/0000-0003-2619-5750 BackgroundPublic health research studies often rely on population-based participation and draw on various recruitment methods to establish samples. Increasingly, researchers are turning to web-based recruitment tools. However, few studies detail traditional and web-based recruitment efforts in terms of costs and potential biases. ObjectiveThis study aims to report on and evaluate the cost-effectiveness, time effectiveness, and sociodemographic representation of diverse recruitment methods used to enroll participants in 3 cities of the Interventions, Research, and Action in Cities Team (INTERACT) study, a cohort study conducted in Canadian cities. MethodsOver 2017 and 2018 in Vancouver, Saskatoon, and Montreal, the INTERACT study used the following recruitment methods: mailed letters, social media (including sponsored Facebook advertisements), news media, partner communications, snowball recruitment, in-person recruitment, and posters. Participation in the study involved answering web-based questionnaires (at minimum), activating a smartphone app to share sensor data, and wearing a device for mobility and physical activity monitoring. We describe sociodemographic characteristics by the recruitment method and analyze performance indicators, including cost, completion rate, and time effectiveness. Effectiveness included calculating cost per completer (ie, a participant who completed at least one questionnaire), the completion rate of a health questionnaire, and the delay between completion of eligibility and health questionnaires. Cost included producing materials (ie, printing costs), transmitting recruitment messages (ie, mailing list rental, postage, and sponsored Facebook posts charges), and staff time. In Montreal, the largest INTERACT sample, we modeled the number of daily recruits through generalized linear models accounting for the distributed lagged effects of recruitment campaigns. ResultsOverall, 1791 participants were recruited from 3 cities and completed at least one questionnaire: 318 in Vancouver, 315 in Saskatoon, and 1158 in Montreal. In all cities, most participants chose to participate fully (questionnaires, apps, and devices). The costs associated with a completed participant varied across recruitment methods and by city. Facebook advertisements generated the most recruits (n=687), at a cost of CAD $15.04 (US $11.57; including staff time) per completer. Mailed letters were the costliest, at CAD $108.30 (US $83.3) per completer but served to reach older participants. All methods resulted in a gender imbalance, with women participating more, specifically with social media. Partner newsletters resulted in the participation of younger adults and were cost-efficient (CAD $5.16 [US $3.97] per completer). A generalized linear model for daily Montreal recruitment identified 2-day lag effects on most recruitment methods, except for the snowball campaign (4 days), letters (15 days), and reminder cards (5 days). ConclusionsThis study presents comprehensive data on the costs, effectiveness, and bias of population recruitment in a cohort study in 3 Canadian cities. More comprehensive documentation and reporting of recruitment efforts across studies are needed to improve our capacity to conduct inclusive intervention research.https://www.jmir.org/2021/11/e21142 |
| spellingShingle | Rania Wasfi Zoe Poirier Stephens Meridith Sones Karen Laberee Caitlin Pugh Daniel Fuller Meghan Winters Yan Kestens Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study Journal of Medical Internet Research |
| title | Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study |
| title_full | Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study |
| title_fullStr | Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study |
| title_full_unstemmed | Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study |
| title_short | Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study |
| title_sort | recruiting participants for population health intervention research effectiveness and costs of recruitment methods for a cohort study |
| url | https://www.jmir.org/2021/11/e21142 |
| work_keys_str_mv | AT raniawasfi recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT zoepoirierstephens recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT meridithsones recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT karenlaberee recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT caitlinpugh recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT danielfuller recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT meghanwinters recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy AT yankestens recruitingparticipantsforpopulationhealthinterventionresearcheffectivenessandcostsofrecruitmentmethodsforacohortstudy |