FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News
Misinformation posting and spreading in social media is ignited by personal decisions on the truthfulness of news that may cause wide and deep cascades at a large scale in a fraction of minutes. When individuals are exposed to information, they usually take a few seconds to decide if the content (or...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-09-01
|
| Series: | Future Internet |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1999-5903/14/10/283 |
| _version_ | 1797431545552699392 |
|---|---|
| author | Giancarlo Ruffo Alfonso Semeraro |
| author_facet | Giancarlo Ruffo Alfonso Semeraro |
| author_sort | Giancarlo Ruffo |
| collection | DOAJ |
| description | Misinformation posting and spreading in social media is ignited by personal decisions on the truthfulness of news that may cause wide and deep cascades at a large scale in a fraction of minutes. When individuals are exposed to information, they usually take a few seconds to decide if the content (or the source) is reliable and whether to share it. Although the opportunity to verify the rumour is often just one click away, many users fail to make a correct evaluation. We studied this phenomenon with a web-based questionnaire that was compiled by 7298 different volunteers, where the participants were asked to mark 20 news items as true or false. Interestingly, false news is correctly identified more frequently than true news, but showing the full article instead of just the title, surprisingly, does not increase general accuracy. Additionally, displaying the original source of the news may contribute to misleading the user in some cases, while the genuine wisdom of the crowd can positively assist individuals’ ability to classify news correctly. Finally, participants whose browsing activity suggests a parallel fact-checking activity show better performance and declare themselves as young adults. This work highlights a series of pitfalls that can influence human annotators when building false news datasets, which in turn can fuel the research on the automated fake news detection; furthermore, these findings challenge the common rationale of AI that suggest users read the full article before re-sharing. |
| first_indexed | 2024-03-09T09:46:43Z |
| format | Article |
| id | doaj.art-3f3733f82862496382f942ba0d30c00b |
| institution | Directory Open Access Journal |
| issn | 1999-5903 |
| language | English |
| last_indexed | 2024-03-09T09:46:43Z |
| publishDate | 2022-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Future Internet |
| spelling | doaj.art-3f3733f82862496382f942ba0d30c00b2023-12-02T00:30:13ZengMDPI AGFuture Internet1999-59032022-09-01141028310.3390/fi14100283FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False NewsGiancarlo Ruffo0Alfonso Semeraro1Department of Computer Science, Università degli Studi di Torino, 10149 Torino, ItalyDepartment of Computer Science, Università degli Studi di Torino, 10149 Torino, ItalyMisinformation posting and spreading in social media is ignited by personal decisions on the truthfulness of news that may cause wide and deep cascades at a large scale in a fraction of minutes. When individuals are exposed to information, they usually take a few seconds to decide if the content (or the source) is reliable and whether to share it. Although the opportunity to verify the rumour is often just one click away, many users fail to make a correct evaluation. We studied this phenomenon with a web-based questionnaire that was compiled by 7298 different volunteers, where the participants were asked to mark 20 news items as true or false. Interestingly, false news is correctly identified more frequently than true news, but showing the full article instead of just the title, surprisingly, does not increase general accuracy. Additionally, displaying the original source of the news may contribute to misleading the user in some cases, while the genuine wisdom of the crowd can positively assist individuals’ ability to classify news correctly. Finally, participants whose browsing activity suggests a parallel fact-checking activity show better performance and declare themselves as young adults. This work highlights a series of pitfalls that can influence human annotators when building false news datasets, which in turn can fuel the research on the automated fake news detection; furthermore, these findings challenge the common rationale of AI that suggest users read the full article before re-sharing.https://www.mdpi.com/1999-5903/14/10/283fake newsmisinformationdisinformationcognitive biasessocial mediasocial influence |
| spellingShingle | Giancarlo Ruffo Alfonso Semeraro FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News Future Internet fake news misinformation disinformation cognitive biases social media social influence |
| title | FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News |
| title_full | FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News |
| title_fullStr | FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News |
| title_full_unstemmed | FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News |
| title_short | FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing Us from Distinguishing True from False News |
| title_sort | fakenewslab experimental study on biases and pitfalls preventing us from distinguishing true from false news |
| topic | fake news misinformation disinformation cognitive biases social media social influence |
| url | https://www.mdpi.com/1999-5903/14/10/283 |
| work_keys_str_mv | AT giancarloruffo fakenewslabexperimentalstudyonbiasesandpitfallspreventingusfromdistinguishingtruefromfalsenews AT alfonsosemeraro fakenewslabexperimentalstudyonbiasesandpitfallspreventingusfromdistinguishingtruefromfalsenews |