Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect
For decades, fear of crime researchers have disagreed about how to best measure fear of crime. One approach proposed that measuring frequency of fear of crime within the past year has the highest validity. We argue that a frequency approach is vulnerable to the anchoring effect, in which participant...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
European Survey Research Association
2024-04-01
|
Series: | Survey Research Methods |
Subjects: | |
Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/8259 |
_version_ | 1797193863761231872 |
---|---|
author | Aubrey L. Etopio Emily R. Berthelot |
author_facet | Aubrey L. Etopio Emily R. Berthelot |
author_sort | Aubrey L. Etopio |
collection | DOAJ |
description | For decades, fear of crime researchers have disagreed about how to best measure fear of crime. One approach proposed that measuring frequency of fear of crime within the past year has the highest validity. We argue that a frequency approach is vulnerable to the anchoring effect, in which participants base their numerical estimate on an available anchor. We conducted a survey experiment to test the effect of question wording on reported frequency of fear of crime. Participants were randomly assigned to report the number of times they felt fearful of crime within either a year, a month, or a week. There was also a fourth condition that asked a forced-choice question with many response options. They also reported the intensity of their most recent instance. We hypothesized that the year condition would yield lower frequency and higher intensity reports, followed by the month condition, and then the week condition. We did not find differences in intensity between conditions, but we found stark differences in frequencies between the year, month, and week conditions in the hypothesized direction. This is consistent with the anchoring effect: the word “year,” “month,” or “week” signaled an anchor to participants, and they adjusted their estimates from those anchors. These findings have important implications for measuring fear of crime and for survey methodology generally. We advise against asking about the frequency of fear of crime because such questions will lead participants to anchor and adjust. We also strongly caution researchers who wish to measure the frequency of other emotions, feelings, or behaviors.
|
first_indexed | 2024-04-24T05:47:09Z |
format | Article |
id | doaj.art-a43eb3bc0862400483b12287eca205be |
institution | Directory Open Access Journal |
issn | 1864-3361 |
language | English |
last_indexed | 2024-04-24T05:47:09Z |
publishDate | 2024-04-01 |
publisher | European Survey Research Association |
record_format | Article |
series | Survey Research Methods |
spelling | doaj.art-a43eb3bc0862400483b12287eca205be2024-04-23T13:35:59ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612024-04-01181Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring EffectAubrey L. Etopio0Emily R. Berthelot1University of Maryland, Baltimore CountyUniversity of Nevada, RenoFor decades, fear of crime researchers have disagreed about how to best measure fear of crime. One approach proposed that measuring frequency of fear of crime within the past year has the highest validity. We argue that a frequency approach is vulnerable to the anchoring effect, in which participants base their numerical estimate on an available anchor. We conducted a survey experiment to test the effect of question wording on reported frequency of fear of crime. Participants were randomly assigned to report the number of times they felt fearful of crime within either a year, a month, or a week. There was also a fourth condition that asked a forced-choice question with many response options. They also reported the intensity of their most recent instance. We hypothesized that the year condition would yield lower frequency and higher intensity reports, followed by the month condition, and then the week condition. We did not find differences in intensity between conditions, but we found stark differences in frequencies between the year, month, and week conditions in the hypothesized direction. This is consistent with the anchoring effect: the word “year,” “month,” or “week” signaled an anchor to participants, and they adjusted their estimates from those anchors. These findings have important implications for measuring fear of crime and for survey methodology generally. We advise against asking about the frequency of fear of crime because such questions will lead participants to anchor and adjust. We also strongly caution researchers who wish to measure the frequency of other emotions, feelings, or behaviors. https://ojs.ub.uni-konstanz.de/srm/article/view/8259fear of crimesurvey methodologyanchoring effectsurvey experimentquestion design |
spellingShingle | Aubrey L. Etopio Emily R. Berthelot Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect Survey Research Methods fear of crime survey methodology anchoring effect survey experiment question design |
title | Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect |
title_full | Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect |
title_fullStr | Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect |
title_full_unstemmed | Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect |
title_short | Question Wording Matters in Measuring Frequency of Fear of Crime: A Survey Experiment of the Anchoring Effect |
title_sort | question wording matters in measuring frequency of fear of crime a survey experiment of the anchoring effect |
topic | fear of crime survey methodology anchoring effect survey experiment question design |
url | https://ojs.ub.uni-konstanz.de/srm/article/view/8259 |
work_keys_str_mv | AT aubreyletopio questionwordingmattersinmeasuringfrequencyoffearofcrimeasurveyexperimentoftheanchoringeffect AT emilyrberthelot questionwordingmattersinmeasuringfrequencyoffearofcrimeasurveyexperimentoftheanchoringeffect |