Development of a rating scale for measuring resistance to persuasive health messages
Background: Pretesting is the key to understanding how the intended audience will react to the message. Resistant reactions affect message processing or can lead to undesirable boomerang effects. The objective of this study was to develop a rating scale for measuring active (reactance) and passive (...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Komiyama Printing Co. Ltd
2022-05-01
|
| Series: | Environmental Health and Preventive Medicine |
| Subjects: | |
| Online Access: | https://www.jstage.jst.go.jp/article/ehpm/27/0/27_22-00059/_html/-char/en |
| _version_ | 1828405317078089728 |
|---|---|
| author | Machi Suka Takashi Shimazaki Takashi Yamauchi Hiroyuki Yanagisawa |
| author_facet | Machi Suka Takashi Shimazaki Takashi Yamauchi Hiroyuki Yanagisawa |
| author_sort | Machi Suka |
| collection | DOAJ |
| description | Background: Pretesting is the key to understanding how the intended audience will react to the message. Resistant reactions affect message processing or can lead to undesirable boomerang effects. The objective of this study was to develop a rating scale for measuring active (reactance) and passive (disengagement) resistance to persuasive health messages. Methods: Six candidate items (3 items for disengagement and 3 items for reactance) were generated based on literature review. A web-based survey was conducted among Japanese adults aged 25–64 years to verify the reliability and validity of the 6-item resistance scale. Participants were asked to rate one of the advance care planning (ACP) promotion messages. All scale items were scored on a 1-to-5 point Likert scale and they were averaged to produce the resistance score. Results: Explanatory factor analysis revealed a two-factor solution that agreed with the disengagement and reactance domains, respectively. Correlation coefficients between each set of items ranged between 0.30–0.69. Cronbach alpha (0.86) indicated satisfactory internal consistency of the set of items. Confirmatory factor analysis showed a good fit of the two-factor model with CFI = 0.998, SRMR = 0.011, and RMSEA = 0.041. The resistance score showed a moderate positive correlation with negative emotional responses (displeasure γ = 0.55, anger γ = 0.53) and was significantly inversely related to the persuasiveness score (γ = −0.50). Multivariable logistic regression analysis showed that the odds ratio for ACP intention per 1-point increase in the resistance score was 0.47 (95% confidence interval 0.40–0.56) with adjustment for the persuasiveness score. Conclusion: The 6-item resistance scale exhibited adequate reliability and validity for measuring audience resistance when applied to the ACP promotion messages in Japanese people. The scale will be useful for pretesting health messages to make them more acceptable to the intended audience. Trial registration: Not applicable; this is not a report of intervention trial. |
| first_indexed | 2024-12-10T10:51:06Z |
| format | Article |
| id | doaj.art-de2abd0f1c484b439982ad77600fc82e |
| institution | Directory Open Access Journal |
| issn | 1342-078X 1347-4715 |
| language | English |
| last_indexed | 2024-12-10T10:51:06Z |
| publishDate | 2022-05-01 |
| publisher | Komiyama Printing Co. Ltd |
| record_format | Article |
| series | Environmental Health and Preventive Medicine |
| spelling | doaj.art-de2abd0f1c484b439982ad77600fc82e2022-12-22T01:52:00ZengKomiyama Printing Co. LtdEnvironmental Health and Preventive Medicine1342-078X1347-47152022-05-0127202010.1265/ehpm.22-00059ehpmDevelopment of a rating scale for measuring resistance to persuasive health messagesMachi Suka0Takashi Shimazaki1Takashi Yamauchi2Hiroyuki Yanagisawa3Department of Public Health and Environmental Medicine, The Jikei University School of MedicineDepartment of Public Health and Environmental Medicine, The Jikei University School of MedicineDepartment of Public Health and Environmental Medicine, The Jikei University School of MedicineThe Jikei University School of MedicineBackground: Pretesting is the key to understanding how the intended audience will react to the message. Resistant reactions affect message processing or can lead to undesirable boomerang effects. The objective of this study was to develop a rating scale for measuring active (reactance) and passive (disengagement) resistance to persuasive health messages. Methods: Six candidate items (3 items for disengagement and 3 items for reactance) were generated based on literature review. A web-based survey was conducted among Japanese adults aged 25–64 years to verify the reliability and validity of the 6-item resistance scale. Participants were asked to rate one of the advance care planning (ACP) promotion messages. All scale items were scored on a 1-to-5 point Likert scale and they were averaged to produce the resistance score. Results: Explanatory factor analysis revealed a two-factor solution that agreed with the disengagement and reactance domains, respectively. Correlation coefficients between each set of items ranged between 0.30–0.69. Cronbach alpha (0.86) indicated satisfactory internal consistency of the set of items. Confirmatory factor analysis showed a good fit of the two-factor model with CFI = 0.998, SRMR = 0.011, and RMSEA = 0.041. The resistance score showed a moderate positive correlation with negative emotional responses (displeasure γ = 0.55, anger γ = 0.53) and was significantly inversely related to the persuasiveness score (γ = −0.50). Multivariable logistic regression analysis showed that the odds ratio for ACP intention per 1-point increase in the resistance score was 0.47 (95% confidence interval 0.40–0.56) with adjustment for the persuasiveness score. Conclusion: The 6-item resistance scale exhibited adequate reliability and validity for measuring audience resistance when applied to the ACP promotion messages in Japanese people. The scale will be useful for pretesting health messages to make them more acceptable to the intended audience. Trial registration: Not applicable; this is not a report of intervention trial.https://www.jstage.jst.go.jp/article/ehpm/27/0/27_22-00059/_html/-char/enhealth messagerating scaledisengagementreactancereliabilityvalidityjapan |
| spellingShingle | Machi Suka Takashi Shimazaki Takashi Yamauchi Hiroyuki Yanagisawa Development of a rating scale for measuring resistance to persuasive health messages Environmental Health and Preventive Medicine health message rating scale disengagement reactance reliability validity japan |
| title | Development of a rating scale for measuring resistance to persuasive health messages |
| title_full | Development of a rating scale for measuring resistance to persuasive health messages |
| title_fullStr | Development of a rating scale for measuring resistance to persuasive health messages |
| title_full_unstemmed | Development of a rating scale for measuring resistance to persuasive health messages |
| title_short | Development of a rating scale for measuring resistance to persuasive health messages |
| title_sort | development of a rating scale for measuring resistance to persuasive health messages |
| topic | health message rating scale disengagement reactance reliability validity japan |
| url | https://www.jstage.jst.go.jp/article/ehpm/27/0/27_22-00059/_html/-char/en |
| work_keys_str_mv | AT machisuka developmentofaratingscaleformeasuringresistancetopersuasivehealthmessages AT takashishimazaki developmentofaratingscaleformeasuringresistancetopersuasivehealthmessages AT takashiyamauchi developmentofaratingscaleformeasuringresistancetopersuasivehealthmessages AT hiroyukiyanagisawa developmentofaratingscaleformeasuringresistancetopersuasivehealthmessages |