Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable
In order to compare data-quality of different data-collection modes, multitrait-multimethod (MTMM) experiments have been implemented in a mixed-mode experiment parallel to the European Social Survey (ESS) fourth round (2008/2009). Special interest lies in measurement effects between the modes which...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Survey Research Association
2013-11-01
|
| Series: | Survey Research Methods |
| Subjects: | |
| Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/5137 |
| _version_ | 1818486018706243584 |
|---|---|
| author | Jorre T.A. Vannieuwenhuyze Melanie Revilla |
| author_facet | Jorre T.A. Vannieuwenhuyze Melanie Revilla |
| author_sort | Jorre T.A. Vannieuwenhuyze |
| collection | DOAJ |
| description | In order to compare data-quality of different data-collection modes, multitrait-multimethod (MTMM) experiments have been implemented in a mixed-mode experiment parallel to the European Social Survey (ESS) fourth round (2008/2009). Special interest lies in measurement effects between the modes which refer to the pure impact of a data-collection mode on the quality. Nevertheless, mere comparison between quality estimates of the different modes does not allow drawing conclusions about measurement effects. Indeed, measurement effects may be completely confounded with selection effects which refer to differences in respondents compositions across the modes. However, by comparing the mixed-mode data with the main ESS data and treating the dataset of origin as an instrumental variable, some conditional measurement effects and selection effects can be disentangled. This paper provides a preliminary exploratory analysis of this approach. The results generally yield low to fair measurement effects while the selection effects on some items are rather large. |
| first_indexed | 2024-12-10T16:17:21Z |
| format | Article |
| id | doaj.art-a29a5ef9131d42cf9104fad12eda43c3 |
| institution | Directory Open Access Journal |
| issn | 1864-3361 |
| language | English |
| last_indexed | 2024-12-10T16:17:21Z |
| publishDate | 2013-11-01 |
| publisher | European Survey Research Association |
| record_format | Article |
| series | Survey Research Methods |
| spelling | doaj.art-a29a5ef9131d42cf9104fad12eda43c32022-12-22T01:41:56ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612013-11-017310.18148/srm/2013.v7i3.51375421Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental VariableJorre T.A. Vannieuwenhuyze0Melanie Revilla1Centre for Sociological Research, KU LeuvenResearch and Expertise Centre for Survey Methodology, Universitat Pompeu FabraIn order to compare data-quality of different data-collection modes, multitrait-multimethod (MTMM) experiments have been implemented in a mixed-mode experiment parallel to the European Social Survey (ESS) fourth round (2008/2009). Special interest lies in measurement effects between the modes which refer to the pure impact of a data-collection mode on the quality. Nevertheless, mere comparison between quality estimates of the different modes does not allow drawing conclusions about measurement effects. Indeed, measurement effects may be completely confounded with selection effects which refer to differences in respondents compositions across the modes. However, by comparing the mixed-mode data with the main ESS data and treating the dataset of origin as an instrumental variable, some conditional measurement effects and selection effects can be disentangled. This paper provides a preliminary exploratory analysis of this approach. The results generally yield low to fair measurement effects while the selection effects on some items are rather large.https://ojs.ub.uni-konstanz.de/srm/article/view/5137Mode effectsMeasurement effectsSelection effectsMultitrait-multimethodReliabilityValidity |
| spellingShingle | Jorre T.A. Vannieuwenhuyze Melanie Revilla Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable Survey Research Methods Mode effects Measurement effects Selection effects Multitrait-multimethod Reliability Validity |
| title | Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable |
| title_full | Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable |
| title_fullStr | Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable |
| title_full_unstemmed | Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable |
| title_short | Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable |
| title_sort | relative mode effects on data quality in mixed mode surveys by an instrumental variable |
| topic | Mode effects Measurement effects Selection effects Multitrait-multimethod Reliability Validity |
| url | https://ojs.ub.uni-konstanz.de/srm/article/view/5137 |
| work_keys_str_mv | AT jorretavannieuwenhuyze relativemodeeffectsondataqualityinmixedmodesurveysbyaninstrumentalvariable AT melanierevilla relativemodeeffectsondataqualityinmixedmodesurveysbyaninstrumentalvariable |