The Number of Choice Tasks and Survey Satisficing in Conjoint Experiments

In recent years, political and social scientists have made increasing use of conjoint survey designs to study decision-making. Here, we study a consequential question which researchers confront when implementing conjoint designs: How many choice tasks can respondents perform before survey satisficin...

ver descrição completa

Detalhes bibliográficos
Main Authors: Bansak, Kirk, Hainmueller, Jens, Hopkins, Daniel J., Yamamoto, Teppei
Outros Autores: Massachusetts Institute of Technology. Department of Political Science
Formato: Artigo
Publicado em: Cambridge University Press (CUP) 2018
Acesso em linha:http://hdl.handle.net/1721.1/118642
https://orcid.org/0000-0002-8079-7675
Descrição
Resumo:In recent years, political and social scientists have made increasing use of conjoint survey designs to study decision-making. Here, we study a consequential question which researchers confront when implementing conjoint designs: How many choice tasks can respondents perform before survey satisficing degrades response quality? To answer the question, we run a set of experiments where respondents are asked to complete as many as 30 conjoint tasks. Experiments conducted through Amazon's Mechanical Turk and Survey Sampling International demonstrate the surprising robustness of conjoint designs, as there are detectable but quite limited increases in survey satisficing as the number of tasks increases. Our evidence suggests that in similar study contexts researchers can assign dozens of tasks without substantial declines in response quality. Key Words: conjoint analysis, survey experiments, survey fatigue, response bias