Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect

For decades, fear of crime researchers have disagreed about how to best measure fear of crime. One approach proposed that measuring frequency of fear of crime within the past year has the highest validity. We argue that a frequency approach is vulnerable to the anchoring effect, in which participant...

Full description

Bibliographic Details
Main Authors: Aubrey L. Etopio, Emily R. Berthelot
Format: Article
Language:English
Published: European Survey Research Association 2024-04-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/8259
_version_ 1797193863761231872
author Aubrey L. Etopio
Emily R. Berthelot
author_facet Aubrey L. Etopio
Emily R. Berthelot
author_sort Aubrey L. Etopio
collection DOAJ
description For decades, fear of crime researchers have disagreed about how to best measure fear of crime. One approach proposed that measuring frequency of fear of crime within the past year has the highest validity. We argue that a frequency approach is vulnerable to the anchoring effect, in which participants base their numerical estimate on an available anchor. We conducted a survey experiment to test the effect of question wording on reported frequency of fear of crime. Participants were randomly assigned to report the number of times they felt fearful of crime within either a year, a month, or a week. There was also a fourth condition that asked a forced-choice question with many response options. They also reported the intensity of their most recent instance. We hypothesized that the year condition would yield lower frequency and higher intensity reports, followed by the month condition, and then the week condition. We did not find differences in intensity between conditions, but we found stark differences in frequencies between the year, month, and week conditions in the hypothesized direction. This is consistent with the anchoring effect: the word “year,” “month,” or “week” signaled an anchor to participants, and they adjusted their estimates from those anchors. These findings have important implications for measuring fear of crime and for survey methodology generally. We advise against asking about the frequency of fear of crime because such questions will lead participants to anchor and adjust. We also strongly caution researchers who wish to measure the frequency of other emotions, feelings, or behaviors.
first_indexed 2024-04-24T05:47:09Z
format Article
id doaj.art-a43eb3bc0862400483b12287eca205be
institution Directory Open Access Journal
issn 1864-3361
language English
last_indexed 2024-04-24T05:47:09Z
publishDate 2024-04-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj.art-a43eb3bc0862400483b12287eca205be2024-04-23T13:35:59ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612024-04-01181Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring EffectAubrey L. Etopio0Emily R. Berthelot1University of Maryland, Baltimore CountyUniversity of Nevada, RenoFor decades, fear of crime researchers have disagreed about how to best measure fear of crime. One approach proposed that measuring frequency of fear of crime within the past year has the highest validity. We argue that a frequency approach is vulnerable to the anchoring effect, in which participants base their numerical estimate on an available anchor. We conducted a survey experiment to test the effect of question wording on reported frequency of fear of crime. Participants were randomly assigned to report the number of times they felt fearful of crime within either a year, a month, or a week. There was also a fourth condition that asked a forced-choice question with many response options. They also reported the intensity of their most recent instance. We hypothesized that the year condition would yield lower frequency and higher intensity reports, followed by the month condition, and then the week condition. We did not find differences in intensity between conditions, but we found stark differences in frequencies between the year, month, and week conditions in the hypothesized direction. This is consistent with the anchoring effect: the word “year,” “month,” or “week” signaled an anchor to participants, and they adjusted their estimates from those anchors. These findings have important implications for measuring fear of crime and for survey methodology generally. We advise against asking about the frequency of fear of crime because such questions will lead participants to anchor and adjust. We also strongly caution researchers who wish to measure the frequency of other emotions, feelings, or behaviors. https://ojs.ub.uni-konstanz.de/srm/article/view/8259fear of crimesurvey methodologyanchoring effectsurvey experimentquestion design
spellingShingle Aubrey L. Etopio
Emily R. Berthelot
Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
Survey Research Methods
fear of crime
survey methodology
anchoring effect
survey experiment
question design
title Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
title_full Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
title_fullStr Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
title_full_unstemmed Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
title_short Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
title_sort question wording matters in measuring frequency of fear of crime a survey experiment of the anchoring effect
topic fear of crime
survey methodology
anchoring effect
survey experiment
question design
url https://ojs.ub.uni-konstanz.de/srm/article/view/8259
work_keys_str_mv AT aubreyletopio questionwordingmattersinmeasuringfrequencyoffearofcrimeasurveyexperimentoftheanchoringeffect
AT emilyrberthelot questionwordingmattersinmeasuringfrequencyoffearofcrimeasurveyexperimentoftheanchoringeffect