Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys

Practitioners use various indicators to screen for meaningless, careless, or fraudulent responses in Internet surveys. This study employs an experimental-like design to empirically test the ability of non-reactive indicators to identify records with low data quality. Findings suggest that careless r...

Full description

Bibliographic Details
Main Author: Dominik Johannes Leiner
Format: Article
Language:English
Published: European Survey Research Association 2019-12-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/7403
_version_ 1811214753146601472
author Dominik Johannes Leiner
author_facet Dominik Johannes Leiner
author_sort Dominik Johannes Leiner
collection DOAJ
description Practitioners use various indicators to screen for meaningless, careless, or fraudulent responses in Internet surveys. This study employs an experimental-like design to empirically test the ability of non-reactive indicators to identify records with low data quality. Findings suggest that careless responses are most reliably identified by questionnaire completion time, but the tested indicators do not allow for detecting intended faking. The article introduces various indicators, their benefits and drawbacks, proposes a completion speed index for common application in data cleaning, and discusses whether to remove meaningless records at all.
first_indexed 2024-04-12T06:09:59Z
format Article
id doaj.art-e524e247ea734c968cd1abe2ac49bb1e
institution Directory Open Access Journal
issn 1864-3361
language English
last_indexed 2024-04-12T06:09:59Z
publishDate 2019-12-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj.art-e524e247ea734c968cd1abe2ac49bb1e2022-12-22T03:44:44ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612019-12-0113310.18148/srm/2019.v13i3.7403Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet SurveysDominik Johannes Leiner0LMU MunichPractitioners use various indicators to screen for meaningless, careless, or fraudulent responses in Internet surveys. This study employs an experimental-like design to empirically test the ability of non-reactive indicators to identify records with low data quality. Findings suggest that careless responses are most reliably identified by questionnaire completion time, but the tested indicators do not allow for detecting intended faking. The article introduces various indicators, their benefits and drawbacks, proposes a completion speed index for common application in data cleaning, and discusses whether to remove meaningless records at all.https://ojs.ub.uni-konstanz.de/srm/article/view/7403data cleaningcareless respondingmeaningless dataparadataweb based surveysonline surveys
spellingShingle Dominik Johannes Leiner
Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
Survey Research Methods
data cleaning
careless responding
meaningless data
paradata
web based surveys
online surveys
title Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
title_full Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
title_fullStr Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
title_full_unstemmed Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
title_short Too Fast, too Straight, too Weird: Non-Reactive Indicators for Meaningless Data in Internet Surveys
title_sort too fast too straight too weird non reactive indicators for meaningless data in internet surveys
topic data cleaning
careless responding
meaningless data
paradata
web based surveys
online surveys
url https://ojs.ub.uni-konstanz.de/srm/article/view/7403
work_keys_str_mv AT dominikjohannesleiner toofasttoostraighttooweirdnonreactiveindicatorsformeaninglessdataininternetsurveys