Effects of mixing modes on nonresponse and measurement error in an economic panel survey

Abstract Numerous panel surveys around the world use multiple modes of data collection to recruit and interview respondents. Previous studies have shown that mixed-mode data collection can improve response rates, reduce nonresponse bias, and reduce survey costs. However, these advantages come at the...

Full description

Bibliographic Details
Main Authors: Joseph W. Sakshaug, Jonas Beste, Mark Trappmann
Format: Article
Language:English
Published: SpringerOpen 2023-01-01
Series:Journal for Labour Market Research
Subjects:
Online Access:https://doi.org/10.1186/s12651-022-00328-1
_version_ 1797958840288804864
author Joseph W. Sakshaug
Jonas Beste
Mark Trappmann
author_facet Joseph W. Sakshaug
Jonas Beste
Mark Trappmann
author_sort Joseph W. Sakshaug
collection DOAJ
description Abstract Numerous panel surveys around the world use multiple modes of data collection to recruit and interview respondents. Previous studies have shown that mixed-mode data collection can improve response rates, reduce nonresponse bias, and reduce survey costs. However, these advantages come at the expense of potential measurement differences between modes. A major challenge in survey research is disentangling measurement error biases from nonresponse biases in order to study how mixing modes affects the development of both error sources over time. In this article, we use linked administrative data to disentangle both nonresponse and measurement error biases in the long-running mixed-mode economic panel study “Labour Market and Social Security” (PASS). Through this study design we answer the question of whether mixing modes reduces nonresponse and measurement error biases compared to a single-mode design. In short, we find that mixing modes reduces nonresponse bias for most variables, particularly in later waves, with only small effects on measurement error bias. The total bias and mean-squared error are both reduced under the mixed-mode design compared to the counterfactual single-mode design, which is a reassuring finding for mixed-mode economic panel surveys.
first_indexed 2024-04-11T00:24:31Z
format Article
id doaj.art-daae45f55d534450bcd302c4a974aa2a
institution Directory Open Access Journal
issn 2510-5027
language English
last_indexed 2024-04-11T00:24:31Z
publishDate 2023-01-01
publisher SpringerOpen
record_format Article
series Journal for Labour Market Research
spelling doaj.art-daae45f55d534450bcd302c4a974aa2a2023-01-08T12:06:40ZengSpringerOpenJournal for Labour Market Research2510-50272023-01-0157111610.1186/s12651-022-00328-1Effects of mixing modes on nonresponse and measurement error in an economic panel surveyJoseph W. Sakshaug0Jonas Beste1Mark Trappmann2Institute for Employment ResearchInstitute for Employment ResearchInstitute for Employment ResearchAbstract Numerous panel surveys around the world use multiple modes of data collection to recruit and interview respondents. Previous studies have shown that mixed-mode data collection can improve response rates, reduce nonresponse bias, and reduce survey costs. However, these advantages come at the expense of potential measurement differences between modes. A major challenge in survey research is disentangling measurement error biases from nonresponse biases in order to study how mixing modes affects the development of both error sources over time. In this article, we use linked administrative data to disentangle both nonresponse and measurement error biases in the long-running mixed-mode economic panel study “Labour Market and Social Security” (PASS). Through this study design we answer the question of whether mixing modes reduces nonresponse and measurement error biases compared to a single-mode design. In short, we find that mixing modes reduces nonresponse bias for most variables, particularly in later waves, with only small effects on measurement error bias. The total bias and mean-squared error are both reduced under the mixed-mode design compared to the counterfactual single-mode design, which is a reassuring finding for mixed-mode economic panel surveys.https://doi.org/10.1186/s12651-022-00328-1Longitudinal surveyMixed-mode surveyPASSMode effectsTotal survey error
spellingShingle Joseph W. Sakshaug
Jonas Beste
Mark Trappmann
Effects of mixing modes on nonresponse and measurement error in an economic panel survey
Journal for Labour Market Research
Longitudinal survey
Mixed-mode survey
PASS
Mode effects
Total survey error
title Effects of mixing modes on nonresponse and measurement error in an economic panel survey
title_full Effects of mixing modes on nonresponse and measurement error in an economic panel survey
title_fullStr Effects of mixing modes on nonresponse and measurement error in an economic panel survey
title_full_unstemmed Effects of mixing modes on nonresponse and measurement error in an economic panel survey
title_short Effects of mixing modes on nonresponse and measurement error in an economic panel survey
title_sort effects of mixing modes on nonresponse and measurement error in an economic panel survey
topic Longitudinal survey
Mixed-mode survey
PASS
Mode effects
Total survey error
url https://doi.org/10.1186/s12651-022-00328-1
work_keys_str_mv AT josephwsakshaug effectsofmixingmodesonnonresponseandmeasurementerrorinaneconomicpanelsurvey
AT jonasbeste effectsofmixingmodesonnonresponseandmeasurementerrorinaneconomicpanelsurvey
AT marktrappmann effectsofmixingmodesonnonresponseandmeasurementerrorinaneconomicpanelsurvey