The choice of response alternatives in COVID-19 social science surveys
Social science research is key for understanding and for predicting compliance with COVID-19 guidelines, and this research relies on survey data. While much focus is on the survey question stems, less is on the response alternatives presented that both constrain responses and convey information abou...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9683556/?tool=EBI |
| _version_ | 1811321975920918528 |
|---|---|
| author | Daniel B. Wright Sarah M. Wolff Rusi Jaspal Julie Barnett Glynis M. Breakwell |
| author_facet | Daniel B. Wright Sarah M. Wolff Rusi Jaspal Julie Barnett Glynis M. Breakwell |
| author_sort | Daniel B. Wright |
| collection | DOAJ |
| description | Social science research is key for understanding and for predicting compliance with COVID-19 guidelines, and this research relies on survey data. While much focus is on the survey question stems, less is on the response alternatives presented that both constrain responses and convey information about the assumed expectations of the survey designers. The focus here is on the choice of response alternatives for the types of behavioral frequency questions used in many COVID-19 and other health surveys. We examine issues with two types of response alternatives. The first are vague quantifiers, like “rarely” and “frequently.” Using data from 30 countries from the Imperial COVID data hub, we show that the interpretation of these vague quantifiers (and their translations) depends on the norms in that country. If the mean amount of hand washing in a country is high, it is likely “frequently” corresponds to a higher numeric value for hand washing than if the mean in the country is low. The second type are sets of numeric alternatives and they can also be problematic. Using a US survey, respondents were randomly allocated to receive either response alternatives where most of the scale corresponds to low frequencies or where most of the scale corresponds to high frequencies. Those given the low frequency set provided lower estimates of the health behaviors. The choice of response alternatives for behavioral frequency questions can affect the estimates of health behaviors. How the response alternatives mold the responses should be taken into account for epidemiological modeling. We conclude with some recommendations for response alternatives for behavioral frequency questions in surveys. |
| first_indexed | 2024-04-13T13:27:00Z |
| format | Article |
| id | doaj.art-61359540bf384fb0b9abbb566302e28d |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-13T13:27:00Z |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-61359540bf384fb0b9abbb566302e28d2022-12-22T02:45:04ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-011711The choice of response alternatives in COVID-19 social science surveysDaniel B. WrightSarah M. WolffRusi JaspalJulie BarnettGlynis M. BreakwellSocial science research is key for understanding and for predicting compliance with COVID-19 guidelines, and this research relies on survey data. While much focus is on the survey question stems, less is on the response alternatives presented that both constrain responses and convey information about the assumed expectations of the survey designers. The focus here is on the choice of response alternatives for the types of behavioral frequency questions used in many COVID-19 and other health surveys. We examine issues with two types of response alternatives. The first are vague quantifiers, like “rarely” and “frequently.” Using data from 30 countries from the Imperial COVID data hub, we show that the interpretation of these vague quantifiers (and their translations) depends on the norms in that country. If the mean amount of hand washing in a country is high, it is likely “frequently” corresponds to a higher numeric value for hand washing than if the mean in the country is low. The second type are sets of numeric alternatives and they can also be problematic. Using a US survey, respondents were randomly allocated to receive either response alternatives where most of the scale corresponds to low frequencies or where most of the scale corresponds to high frequencies. Those given the low frequency set provided lower estimates of the health behaviors. The choice of response alternatives for behavioral frequency questions can affect the estimates of health behaviors. How the response alternatives mold the responses should be taken into account for epidemiological modeling. We conclude with some recommendations for response alternatives for behavioral frequency questions in surveys.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9683556/?tool=EBI |
| spellingShingle | Daniel B. Wright Sarah M. Wolff Rusi Jaspal Julie Barnett Glynis M. Breakwell The choice of response alternatives in COVID-19 social science surveys PLoS ONE |
| title | The choice of response alternatives in COVID-19 social science surveys |
| title_full | The choice of response alternatives in COVID-19 social science surveys |
| title_fullStr | The choice of response alternatives in COVID-19 social science surveys |
| title_full_unstemmed | The choice of response alternatives in COVID-19 social science surveys |
| title_short | The choice of response alternatives in COVID-19 social science surveys |
| title_sort | choice of response alternatives in covid 19 social science surveys |
| url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9683556/?tool=EBI |
| work_keys_str_mv | AT danielbwright thechoiceofresponsealternativesincovid19socialsciencesurveys AT sarahmwolff thechoiceofresponsealternativesincovid19socialsciencesurveys AT rusijaspal thechoiceofresponsealternativesincovid19socialsciencesurveys AT juliebarnett thechoiceofresponsealternativesincovid19socialsciencesurveys AT glynismbreakwell thechoiceofresponsealternativesincovid19socialsciencesurveys AT danielbwright choiceofresponsealternativesincovid19socialsciencesurveys AT sarahmwolff choiceofresponsealternativesincovid19socialsciencesurveys AT rusijaspal choiceofresponsealternativesincovid19socialsciencesurveys AT juliebarnett choiceofresponsealternativesincovid19socialsciencesurveys AT glynismbreakwell choiceofresponsealternativesincovid19socialsciencesurveys |