Evidence-Aware Multilingual Fake News Detection
Due to the rapid growth of the Internet and the subsequent rise of social media users, sharing information has become more flexible than ever before. This unrestricted freedom has also led to an increase in fake news. During the Covid-19 outbreak, fake news spread globally, negatively affecting auth...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9941114/ |
| _version_ | 1811312464586866688 |
|---|---|
| author | Hicham Hammouchi Mounir Ghogho |
| author_facet | Hicham Hammouchi Mounir Ghogho |
| author_sort | Hicham Hammouchi |
| collection | DOAJ |
| description | Due to the rapid growth of the Internet and the subsequent rise of social media users, sharing information has become more flexible than ever before. This unrestricted freedom has also led to an increase in fake news. During the Covid-19 outbreak, fake news spread globally, negatively affecting authorities’ decisions and the health of individuals. As a result, governments, media agencies, and academics have established fact-checking units and developed automatic detection systems. Research approaches to verify the veracity of news focused largely on writing styles, propagation patterns, and building knowledge bases that serve as a reference for fact checking. However, little work has been done to assess the credibility of the source of the claim to be checked. This paper proposes a general framework for detecting fake news that uses external evidence to verify the veracity of online news in a multilingual setting. Search results from Google are used as evidence, and the claim is cross-checked with the top five search results. Additionally, we associate a vector of credibility scores with each evidence source based on the domain name and website reputation metrics. All of these components are combined to derive better predictions of the veracity of claims. Further, we analyze the claim-evidence entailment relationship and select supporting and refuting evidence to cross-check with the claim. The approach without selection components yields better detection performance. In this work, we consider as a case study Covid-19 related news. Our framework achieves an F1-score of 0.85 and 0.97 in distinguishing fake from true news on XFact and Constraint datasets respectively. With the achieved results, the proposed framework present a promising automatic fact checker for both early and late detection. |
| first_indexed | 2024-04-13T10:37:50Z |
| format | Article |
| id | doaj.art-1d08aad64ea343e8a65117e58c6efaa7 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-13T10:37:50Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-1d08aad64ea343e8a65117e58c6efaa72022-12-22T02:50:01ZengIEEEIEEE Access2169-35362022-01-011011680811681810.1109/ACCESS.2022.32206909941114Evidence-Aware Multilingual Fake News DetectionHicham Hammouchi0https://orcid.org/0000-0002-0572-218XMounir Ghogho1https://orcid.org/0000-0002-0055-7867TICLab, College of Engineering and Architecture, International University of Rabat, Salé, MoroccoTICLab, College of Engineering and Architecture, International University of Rabat, Salé, MoroccoDue to the rapid growth of the Internet and the subsequent rise of social media users, sharing information has become more flexible than ever before. This unrestricted freedom has also led to an increase in fake news. During the Covid-19 outbreak, fake news spread globally, negatively affecting authorities’ decisions and the health of individuals. As a result, governments, media agencies, and academics have established fact-checking units and developed automatic detection systems. Research approaches to verify the veracity of news focused largely on writing styles, propagation patterns, and building knowledge bases that serve as a reference for fact checking. However, little work has been done to assess the credibility of the source of the claim to be checked. This paper proposes a general framework for detecting fake news that uses external evidence to verify the veracity of online news in a multilingual setting. Search results from Google are used as evidence, and the claim is cross-checked with the top five search results. Additionally, we associate a vector of credibility scores with each evidence source based on the domain name and website reputation metrics. All of these components are combined to derive better predictions of the veracity of claims. Further, we analyze the claim-evidence entailment relationship and select supporting and refuting evidence to cross-check with the claim. The approach without selection components yields better detection performance. In this work, we consider as a case study Covid-19 related news. Our framework achieves an F1-score of 0.85 and 0.97 in distinguishing fake from true news on XFact and Constraint datasets respectively. With the achieved results, the proposed framework present a promising automatic fact checker for both early and late detection.https://ieeexplore.ieee.org/document/9941114/Information extractionfake news detectionclassificationevidence-awaresource credibility |
| spellingShingle | Hicham Hammouchi Mounir Ghogho Evidence-Aware Multilingual Fake News Detection IEEE Access Information extraction fake news detection classification evidence-aware source credibility |
| title | Evidence-Aware Multilingual Fake News Detection |
| title_full | Evidence-Aware Multilingual Fake News Detection |
| title_fullStr | Evidence-Aware Multilingual Fake News Detection |
| title_full_unstemmed | Evidence-Aware Multilingual Fake News Detection |
| title_short | Evidence-Aware Multilingual Fake News Detection |
| title_sort | evidence aware multilingual fake news detection |
| topic | Information extraction fake news detection classification evidence-aware source credibility |
| url | https://ieeexplore.ieee.org/document/9941114/ |
| work_keys_str_mv | AT hichamhammouchi evidenceawaremultilingualfakenewsdetection AT mounirghogho evidenceawaremultilingualfakenewsdetection |