Survey Mode Effects in a Developing Country

Responses to phone surveys tend to exhibit higher rates of social desirability bias and extreme responses when compared to face-to-face surveys. Yet, studies of mode effects typically compare either representative studies that implausibly assume comparability or experimental studies that rely on con...

Full description

Bibliographic Details
Main Authors: Noam Lupu, Adam Wolsky
Format: Article
Language:English
Published: Ediciones Universidad de Salamanca 2023-01-01
Series:Revista Latinoamericana de Opinión Pública
Subjects:
Online Access:https://revistas.usal.es/cuatro/index.php/1852-9003/article/view/30159
Description
Summary:Responses to phone surveys tend to exhibit higher rates of social desirability bias and extreme responses when compared to face-to-face surveys. Yet, studies of mode effects typically compare either representative studies that implausibly assume comparability or experimental studies that rely on convenience samples. Our study compares two national probability samples but uses matching to address comparability. We study Costa Rica, a middle-income democracy, to see whether the conventional wisdom drawn from Western Europe and North America extends to the Global South. We analyze two nationally representative surveys, one fielded by phone and one face-to-face, allowing us to compare identically worded items we placed on both surveys. We find that phone respondents exhibited more socially desirable responding and were more likely to choose negative endpoints on scalar items. This suggests that survey researchers and practitioners should carefully assess the tradeoffs in shifting modes or employing mixed modes.
ISSN:1852-9003
2660-700X