Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach

So far, most surveys used face-to-face or telephone questionnaires in order to collect data. But the costs of achieving a survey using these traditional modes increase. At the same time, the response rates decrease, making the idea of switching mode very attractive. Because each mode has its own wea...

Full description

Bibliographic Details
Main Author: Melanie Revilla
Format: Article
Language:English
Published: European Survey Research Association 2010-12-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/4278
_version_ 1818486039937810432
author Melanie Revilla
author_facet Melanie Revilla
author_sort Melanie Revilla
collection DOAJ
description So far, most surveys used face-to-face or telephone questionnaires in order to collect data. But the costs of achieving a survey using these traditional modes increase. At the same time, the response rates decrease, making the idea of switching mode very attractive. Because each mode has its own weaknesses and strengths, the idea of mixing modes of data collection is becoming more and more popular. Nevertheless, combining different modes of data collection may be problematic if people answer differently depending on the mode. Also, a switch from a unimode to a mixed-mode design may threaten the comparability of the data across time. This paper focuses first on the selection effect and shows that different kinds of respondents answer in different modes: therefore, mixing modes might make sense since it may improve the representativeness of the sample keeping the costs low. It is still necessary however to guarantee that mixing modes would not threaten the comparability. Then, the paper therefore compares the quality of questions asked in a unimode and two mixed-mode surveys. Using data of the European Social Survey (ESS) in the Netherlands, and following a multitrait-multimethod approach (MTMM), few differences are found between the unimode and mixed-mode designs in terms of quality. Looking at the differences across modes lead to slightly less similarities, but overall the quality does not change much.
first_indexed 2024-12-10T16:17:37Z
format Article
id doaj.art-e834c65135f24a3daeb3e9b8025d4638
institution Directory Open Access Journal
issn 1864-3361
language English
last_indexed 2024-12-10T16:17:37Z
publishDate 2010-12-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj.art-e834c65135f24a3daeb3e9b8025d46382022-12-22T01:41:56ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612010-12-014310.18148/srm/2010.v4i3.42784490Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approachMelanie Revilla0Universitat Pompeu FabraSo far, most surveys used face-to-face or telephone questionnaires in order to collect data. But the costs of achieving a survey using these traditional modes increase. At the same time, the response rates decrease, making the idea of switching mode very attractive. Because each mode has its own weaknesses and strengths, the idea of mixing modes of data collection is becoming more and more popular. Nevertheless, combining different modes of data collection may be problematic if people answer differently depending on the mode. Also, a switch from a unimode to a mixed-mode design may threaten the comparability of the data across time. This paper focuses first on the selection effect and shows that different kinds of respondents answer in different modes: therefore, mixing modes might make sense since it may improve the representativeness of the sample keeping the costs low. It is still necessary however to guarantee that mixing modes would not threaten the comparability. Then, the paper therefore compares the quality of questions asked in a unimode and two mixed-mode surveys. Using data of the European Social Survey (ESS) in the Netherlands, and following a multitrait-multimethod approach (MTMM), few differences are found between the unimode and mixed-mode designs in terms of quality. Looking at the differences across modes lead to slightly less similarities, but overall the quality does not change much.https://ojs.ub.uni-konstanz.de/srm/article/view/4278Modes of data collectionconcurrent or sequential designsselection bias
spellingShingle Melanie Revilla
Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach
Survey Research Methods
Modes of data collection
concurrent or sequential designs
selection bias
title Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach
title_full Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach
title_fullStr Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach
title_full_unstemmed Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach
title_short Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach
title_sort quality in unimode and mixed mode designs a multitrait multimethod approach
topic Modes of data collection
concurrent or sequential designs
selection bias
url https://ojs.ub.uni-konstanz.de/srm/article/view/4278
work_keys_str_mv AT melanierevilla qualityinunimodeandmixedmodedesignsamultitraitmultimethodapproach