Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects
This validation study on the crosswise model (CM) examines five survey experiments that were implemented in a general population survey. Our first crucial result is that in none of these experiments was the crosswise model able to verifiably reduce social desirability bias. In contrast to most p...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Survey Research Association
2022-11-01
|
| Series: | Survey Research Methods |
| Subjects: | |
| Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/8010 |
| _version_ | 1797660642617851904 |
|---|---|
| author | Sandra Walzenbach Thomas Hinz |
| author_facet | Sandra Walzenbach Thomas Hinz |
| author_sort | Sandra Walzenbach |
| collection | DOAJ |
| description |
This validation study on the crosswise model (CM) examines five survey experiments that were implemented in a general population survey. Our first crucial result is that in none of these experiments was the crosswise model able to verifiably reduce social desirability bias.
In contrast to most previous CM applications, we use an experimental design that allows us to distinguish a reduction in social desirability bias from heuristic response behaviour, such as random ticking, leading to false positive or false negative answers. In addition, we provide insights on two potential explanatory mechanisms that have not yet received attention in empirical studies: primacy effects and panel conditioning. We do not find consistent primacy effects, nor does response quality improve due to learning when respondents have had experiences with crosswise models in past survey waves. We interpret our results as evidence that the crosswise model does not work in general population surveys and speculate that the question format causes mistrust in participants.
|
| first_indexed | 2024-03-11T18:33:52Z |
| format | Article |
| id | doaj.art-5770e783714841b185bf8ecca359093e |
| institution | Directory Open Access Journal |
| issn | 1864-3361 |
| language | English |
| last_indexed | 2024-03-11T18:33:52Z |
| publishDate | 2022-11-01 |
| publisher | European Survey Research Association |
| record_format | Article |
| series | Survey Research Methods |
| spelling | doaj.art-5770e783714841b185bf8ecca359093e2023-10-13T07:35:22ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612022-11-0117110.18148/srm/2023.v17i1.8010Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning EffectsSandra WalzenbachThomas Hinz This validation study on the crosswise model (CM) examines five survey experiments that were implemented in a general population survey. Our first crucial result is that in none of these experiments was the crosswise model able to verifiably reduce social desirability bias. In contrast to most previous CM applications, we use an experimental design that allows us to distinguish a reduction in social desirability bias from heuristic response behaviour, such as random ticking, leading to false positive or false negative answers. In addition, we provide insights on two potential explanatory mechanisms that have not yet received attention in empirical studies: primacy effects and panel conditioning. We do not find consistent primacy effects, nor does response quality improve due to learning when respondents have had experiences with crosswise models in past survey waves. We interpret our results as evidence that the crosswise model does not work in general population surveys and speculate that the question format causes mistrust in participants. https://ojs.ub.uni-konstanz.de/srm/article/view/8010crosswise modelrandomized responsesocial desirability biasprimacy effectslearning effectspanel conditioning |
| spellingShingle | Sandra Walzenbach Thomas Hinz Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects Survey Research Methods crosswise model randomized response social desirability bias primacy effects learning effects panel conditioning |
| title | Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects |
| title_full | Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects |
| title_fullStr | Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects |
| title_full_unstemmed | Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects |
| title_short | Puzzling Answers to Crosswise Questions: Examining Overall Prevalence Rates, Response Order Effects, and Learning Effects |
| title_sort | puzzling answers to crosswise questions examining overall prevalence rates response order effects and learning effects |
| topic | crosswise model randomized response social desirability bias primacy effects learning effects panel conditioning |
| url | https://ojs.ub.uni-konstanz.de/srm/article/view/8010 |
| work_keys_str_mv | AT sandrawalzenbach puzzlinganswerstocrosswisequestionsexaminingoverallprevalenceratesresponseordereffectsandlearningeffects AT thomashinz puzzlinganswerstocrosswisequestionsexaminingoverallprevalenceratesresponseordereffectsandlearningeffects |