Realtime user ratings as a strategy for combatting misinformation: an experimental study
Abstract Because fact-checking takes time, verdicts are usually reached after a message has gone viral and interventions can have only limited effect. A new approach recently proposed in scholarship and piloted on online platforms is to harness the wisdom of the crowd by enabling recipients of an on...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-01-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-023-28597-x |
| _version_ | 1828051706863157248 |
|---|---|
| author | Jonas Stein Vincenz Frey Arnout van de Rijt |
| author_facet | Jonas Stein Vincenz Frey Arnout van de Rijt |
| author_sort | Jonas Stein |
| collection | DOAJ |
| description | Abstract Because fact-checking takes time, verdicts are usually reached after a message has gone viral and interventions can have only limited effect. A new approach recently proposed in scholarship and piloted on online platforms is to harness the wisdom of the crowd by enabling recipients of an online message to attach veracity assessments to it. The intention is to allow poor initial crowd reception to temper belief in and further spread of misinformation. We study this approach by letting 4000 subjects in 80 experimental bipartisan communities sequentially rate the veracity of informational messages. We find that in well-mixed communities, the public display of earlier veracity ratings indeed enhances the correct classification of true and false messages by subsequent users. However, crowd intelligence backfires when false information is sequentially rated in ideologically segregated communities. This happens because early raters’ ideological bias, which is aligned with a message, influences later raters’ assessments away from the truth. These results suggest that network segregation poses an important problem for community misinformation detection systems that must be accounted for in the design of such systems. |
| first_indexed | 2024-04-10T19:42:50Z |
| format | Article |
| id | doaj.art-2ed207e92c504c1d927d3857e5d0a230 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-04-10T19:42:50Z |
| publishDate | 2023-01-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-2ed207e92c504c1d927d3857e5d0a2302023-01-29T12:11:16ZengNature PortfolioScientific Reports2045-23222023-01-0113111010.1038/s41598-023-28597-xRealtime user ratings as a strategy for combatting misinformation: an experimental studyJonas Stein0Vincenz Frey1Arnout van de Rijt2Department of Sociology , University of GroningenDepartment of Sociology , University of GroningenDepartment of Sociology, European University InstituteAbstract Because fact-checking takes time, verdicts are usually reached after a message has gone viral and interventions can have only limited effect. A new approach recently proposed in scholarship and piloted on online platforms is to harness the wisdom of the crowd by enabling recipients of an online message to attach veracity assessments to it. The intention is to allow poor initial crowd reception to temper belief in and further spread of misinformation. We study this approach by letting 4000 subjects in 80 experimental bipartisan communities sequentially rate the veracity of informational messages. We find that in well-mixed communities, the public display of earlier veracity ratings indeed enhances the correct classification of true and false messages by subsequent users. However, crowd intelligence backfires when false information is sequentially rated in ideologically segregated communities. This happens because early raters’ ideological bias, which is aligned with a message, influences later raters’ assessments away from the truth. These results suggest that network segregation poses an important problem for community misinformation detection systems that must be accounted for in the design of such systems.https://doi.org/10.1038/s41598-023-28597-x |
| spellingShingle | Jonas Stein Vincenz Frey Arnout van de Rijt Realtime user ratings as a strategy for combatting misinformation: an experimental study Scientific Reports |
| title | Realtime user ratings as a strategy for combatting misinformation: an experimental study |
| title_full | Realtime user ratings as a strategy for combatting misinformation: an experimental study |
| title_fullStr | Realtime user ratings as a strategy for combatting misinformation: an experimental study |
| title_full_unstemmed | Realtime user ratings as a strategy for combatting misinformation: an experimental study |
| title_short | Realtime user ratings as a strategy for combatting misinformation: an experimental study |
| title_sort | realtime user ratings as a strategy for combatting misinformation an experimental study |
| url | https://doi.org/10.1038/s41598-023-28597-x |
| work_keys_str_mv | AT jonasstein realtimeuserratingsasastrategyforcombattingmisinformationanexperimentalstudy AT vincenzfrey realtimeuserratingsasastrategyforcombattingmisinformationanexperimentalstudy AT arnoutvanderijt realtimeuserratingsasastrategyforcombattingmisinformationanexperimentalstudy |