Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment

The work of Smyth, Dillman, Christian, and Stern (2006) and Smyth, Christian, and Dillman (2008) compares “yes/no” questions to “check all that apply” questions. They conclude that the “yes/no” format is preferable as it reflects deeper processing of survey questions. Smyth et al. (2008) found that...

Full description

Bibliographic Details
Main Authors: Gerry Nicolaas, Pamela Campanelli, Steven Hope, Annette Jäckle, Peter Lynn
Format: Article
Language:English
Published: European Survey Research Association 2015-12-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/6151
_version_ 1818485984425148416
author Gerry Nicolaas
Pamela Campanelli
Steven Hope
Annette Jäckle
Peter Lynn
author_facet Gerry Nicolaas
Pamela Campanelli
Steven Hope
Annette Jäckle
Peter Lynn
author_sort Gerry Nicolaas
collection DOAJ
description The work of Smyth, Dillman, Christian, and Stern (2006) and Smyth, Christian, and Dillman (2008) compares “yes/no” questions to “check all that apply” questions. They conclude that the “yes/no” format is preferable as it reflects deeper processing of survey questions. Smyth et al. (2008) found that the “yes/no” format performed similarly across telephone and web modes. In this paper we replicate their research and extend it by including a comparison with face-to-face in addition to telephone and web and by using probability samples of the general adult population. A cognitive interviewing follow-up was used to explore the quantitative findings. Our results suggest there are times when the “yes/no” format may not perform similarly across modes and that there may be factors which limit the quality of answers.
first_indexed 2024-12-10T16:16:52Z
format Article
id doaj.art-2400a3f404b9490aba5b628d53a960a5
institution Directory Open Access Journal
issn 1864-3361
language English
last_indexed 2024-12-10T16:16:52Z
publishDate 2015-12-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj.art-2400a3f404b9490aba5b628d53a960a52022-12-22T01:41:56ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612015-12-019310.18148/srm/2015.v9i3.61515729Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experimentGerry Nicolaas0Pamela Campanelli1Steven Hope2Annette Jäckle3Peter Lynn4Ipsos MORIThe Survey CoachUniversity College LondonUniversity of EssexUniversity of EssexThe work of Smyth, Dillman, Christian, and Stern (2006) and Smyth, Christian, and Dillman (2008) compares “yes/no” questions to “check all that apply” questions. They conclude that the “yes/no” format is preferable as it reflects deeper processing of survey questions. Smyth et al. (2008) found that the “yes/no” format performed similarly across telephone and web modes. In this paper we replicate their research and extend it by including a comparison with face-to-face in addition to telephone and web and by using probability samples of the general adult population. A cognitive interviewing follow-up was used to explore the quantitative findings. Our results suggest there are times when the “yes/no” format may not perform similarly across modes and that there may be factors which limit the quality of answers.https://ojs.ub.uni-konstanz.de/srm/article/view/6151survey methodsmode of data collectionquestionnaire designcheck all that applyforced choice
spellingShingle Gerry Nicolaas
Pamela Campanelli
Steven Hope
Annette Jäckle
Peter Lynn
Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment
Survey Research Methods
survey methods
mode of data collection
questionnaire design
check all that apply
forced choice
title Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment
title_full Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment
title_fullStr Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment
title_full_unstemmed Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment
title_short Revisiting "yes/no" versus "check all that apply": Results from a mixed modes experiment
title_sort revisiting yes no versus check all that apply results from a mixed modes experiment
topic survey methods
mode of data collection
questionnaire design
check all that apply
forced choice
url https://ojs.ub.uni-konstanz.de/srm/article/view/6151
work_keys_str_mv AT gerrynicolaas revisitingyesnoversuscheckallthatapplyresultsfromamixedmodesexperiment
AT pamelacampanelli revisitingyesnoversuscheckallthatapplyresultsfromamixedmodesexperiment
AT stevenhope revisitingyesnoversuscheckallthatapplyresultsfromamixedmodesexperiment
AT annettejackle revisitingyesnoversuscheckallthatapplyresultsfromamixedmodesexperiment
AT peterlynn revisitingyesnoversuscheckallthatapplyresultsfromamixedmodesexperiment