Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
Practitioners use various indicators to screen for meaningless, careless, or fraudulent responses in Internet surveys. This study employs an experimental-like design to empirically test the ability of non-reactive indicators to identify records with low data quality. Findings suggest that careless r...
Main Author: | |
---|---|
Format: | Article |
Language: | English |
Published: |
European Survey Research Association
2019-12-01
|
Series: | Survey Research Methods |
Subjects: | |
Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/7403 |
_version_ | 1811214753146601472 |
---|---|
author | Dominik Johannes Leiner |
author_facet | Dominik Johannes Leiner |
author_sort | Dominik Johannes Leiner |
collection | DOAJ |
description | Practitioners use various indicators to screen for meaningless, careless, or fraudulent responses in Internet surveys. This study employs an experimental-like design to empirically test the ability of non-reactive indicators to identify records with low data quality. Findings suggest that careless responses are most reliably identified by questionnaire completion time, but the tested indicators do not allow for detecting intended faking. The article introduces various indicators, their benefits and drawbacks, proposes a completion speed index for common application in data cleaning, and discusses whether to remove meaningless records at all. |
first_indexed | 2024-04-12T06:09:59Z |
format | Article |
id | doaj.art-e524e247ea734c968cd1abe2ac49bb1e |
institution | Directory Open Access Journal |
issn | 1864-3361 |
language | English |
last_indexed | 2024-04-12T06:09:59Z |
publishDate | 2019-12-01 |
publisher | European Survey Research Association |
record_format | Article |
series | Survey Research Methods |
spelling | doaj.art-e524e247ea734c968cd1abe2ac49bb1e2022-12-22T03:44:44ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612019-12-0113310.18148/srm/2019.v13i3.7403Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet SurveysDominik Johannes Leiner0LMU MunichPractitioners use various indicators to screen for meaningless, careless, or fraudulent responses in Internet surveys. This study employs an experimental-like design to empirically test the ability of non-reactive indicators to identify records with low data quality. Findings suggest that careless responses are most reliably identified by questionnaire completion time, but the tested indicators do not allow for detecting intended faking. The article introduces various indicators, their benefits and drawbacks, proposes a completion speed index for common application in data cleaning, and discusses whether to remove meaningless records at all.https://ojs.ub.uni-konstanz.de/srm/article/view/7403data cleaningcareless respondingmeaningless dataparadataweb based surveysonline surveys |
spellingShingle | Dominik Johannes Leiner Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys Survey Research Methods data cleaning careless responding meaningless data paradata web based surveys online surveys |
title | Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys |
title_full | Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys |
title_fullStr | Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys |
title_full_unstemmed | Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys |
title_short | Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys |
title_sort | too fast too straight too weird non reactive indicators for meaningless data in internet surveys |
topic | data cleaning careless responding meaningless data paradata web based surveys online surveys |
url | https://ojs.ub.uni-konstanz.de/srm/article/view/7403 |
work_keys_str_mv | AT dominikjohannesleiner toofasttoostraighttooweirdnonreactiveindicatorsformeaninglessdataininternetsurveys |