A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial

<p>Abstract</p> <p>Background</p> <p>Maximizing response rates is critically important in order to provide the most generalizable and unbiased research results. High response rates reduce the chance of respondents being systematically different from non-respondents, and...

Full description

Bibliographic Details
Main Authors: Grill Joseph P, Stevenson John, Hulbert Erin, Simon Alisha, Griffin Joan M, Noorbaloochi Siamak, Partin Melissa R
Format: Article
Language:English
Published: BMC 2011-05-01
Series:BMC Medical Research Methodology
Subjects:
Online Access:http://www.biomedcentral.com/1471-2288/11/81
_version_ 1811297102260600832
author Grill Joseph P
Stevenson John
Hulbert Erin
Simon Alisha
Griffin Joan M
Noorbaloochi Siamak
Partin Melissa R
author_facet Grill Joseph P
Stevenson John
Hulbert Erin
Simon Alisha
Griffin Joan M
Noorbaloochi Siamak
Partin Melissa R
author_sort Grill Joseph P
collection DOAJ
description <p>Abstract</p> <p>Background</p> <p>Maximizing response rates is critically important in order to provide the most generalizable and unbiased research results. High response rates reduce the chance of respondents being systematically different from non-respondents, and thus, reduce the risk of results not truly reflecting the study population. Monetary incentives are often used to improve response rates, but little is known about whether larger incentives improve response rates in those who previously have been unenthusiastic about participating in research. In this study we compared the response rates and cost-effectiveness of a $5 versus $2 monetary incentive accompanying a short survey mailed to patients who did not respond or refused to participate in research study with a face-to-face survey.</p> <p>Methods</p> <p>1,328 non-responders were randomly assigned to receive $5 or $2 and a short, 10-question survey by mail. Reminder postcards were sent to everyone; those not returning the survey were sent a second survey without incentive. Overall response rates, response rates by incentive condition, and odds of responding to the larger incentive were calculated. Total costs (materials, postage, and labor) and incremental cost-effectiveness ratios were also calculated and compared by incentive condition.</p> <p>Results</p> <p>After the first mailing, the response rate within the $5 group was significantly higher (57.8% vs. 47.7%, p < .001); after the second mailing, the difference narrowed by 80%, resulting in a non-significant difference in cumulative rates between the $5 and $2 groups (67.3% vs. 65.4%, respectively, p = .47). Regardless of incentive or number of contacts, respondents were significantly more likely to be male, white, married, and 50-75 years old. Total costs were higher with the larger versus smaller incentive ($13.77 versus $9.95 per completed survey).</p> <p>Conclusions</p> <p>A $5 incentive provides a significantly higher response rate than a $2 incentive if only one survey mailing is used but not if two survey mailings are used.</p>
first_indexed 2024-04-13T05:59:07Z
format Article
id doaj.art-f18c1b9baf9a4eecb2e841ddee5f5515
institution Directory Open Access Journal
issn 1471-2288
language English
last_indexed 2024-04-13T05:59:07Z
publishDate 2011-05-01
publisher BMC
record_format Article
series BMC Medical Research Methodology
spelling doaj.art-f18c1b9baf9a4eecb2e841ddee5f55152022-12-22T02:59:31ZengBMCBMC Medical Research Methodology1471-22882011-05-011118110.1186/1471-2288-11-81A comparison of small monetary incentives to convert survey non-respondents: a randomized control trialGrill Joseph PStevenson JohnHulbert ErinSimon AlishaGriffin Joan MNoorbaloochi SiamakPartin Melissa R<p>Abstract</p> <p>Background</p> <p>Maximizing response rates is critically important in order to provide the most generalizable and unbiased research results. High response rates reduce the chance of respondents being systematically different from non-respondents, and thus, reduce the risk of results not truly reflecting the study population. Monetary incentives are often used to improve response rates, but little is known about whether larger incentives improve response rates in those who previously have been unenthusiastic about participating in research. In this study we compared the response rates and cost-effectiveness of a $5 versus $2 monetary incentive accompanying a short survey mailed to patients who did not respond or refused to participate in research study with a face-to-face survey.</p> <p>Methods</p> <p>1,328 non-responders were randomly assigned to receive $5 or $2 and a short, 10-question survey by mail. Reminder postcards were sent to everyone; those not returning the survey were sent a second survey without incentive. Overall response rates, response rates by incentive condition, and odds of responding to the larger incentive were calculated. Total costs (materials, postage, and labor) and incremental cost-effectiveness ratios were also calculated and compared by incentive condition.</p> <p>Results</p> <p>After the first mailing, the response rate within the $5 group was significantly higher (57.8% vs. 47.7%, p < .001); after the second mailing, the difference narrowed by 80%, resulting in a non-significant difference in cumulative rates between the $5 and $2 groups (67.3% vs. 65.4%, respectively, p = .47). Regardless of incentive or number of contacts, respondents were significantly more likely to be male, white, married, and 50-75 years old. Total costs were higher with the larger versus smaller incentive ($13.77 versus $9.95 per completed survey).</p> <p>Conclusions</p> <p>A $5 incentive provides a significantly higher response rate than a $2 incentive if only one survey mailing is used but not if two survey mailings are used.</p>http://www.biomedcentral.com/1471-2288/11/81Cost-effectivenessdata collectionincremental cost-effectiveness ratiosfinancial incentivesresponse ratenon-response
spellingShingle Grill Joseph P
Stevenson John
Hulbert Erin
Simon Alisha
Griffin Joan M
Noorbaloochi Siamak
Partin Melissa R
A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial
BMC Medical Research Methodology
Cost-effectiveness
data collection
incremental cost-effectiveness ratios
financial incentives
response rate
non-response
title A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial
title_full A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial
title_fullStr A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial
title_full_unstemmed A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial
title_short A comparison of small monetary incentives to convert survey non-respondents: a randomized control trial
title_sort comparison of small monetary incentives to convert survey non respondents a randomized control trial
topic Cost-effectiveness
data collection
incremental cost-effectiveness ratios
financial incentives
response rate
non-response
url http://www.biomedcentral.com/1471-2288/11/81
work_keys_str_mv AT grilljosephp acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT stevensonjohn acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT hulberterin acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT simonalisha acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT griffinjoanm acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT noorbaloochisiamak acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT partinmelissar acomparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT grilljosephp comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT stevensonjohn comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT hulberterin comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT simonalisha comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT griffinjoanm comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT noorbaloochisiamak comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial
AT partinmelissar comparisonofsmallmonetaryincentivestoconvertsurveynonrespondentsarandomizedcontroltrial