Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating
This dissertation explores feature fusion by combining RoBERTa and Knowledge Graph (KG) techniques using Gated Units to improve the accuracy of fake news detection. In text processing, RoBERTa model is able to understand and classify false content effectively due to its pre-training advantage. On th...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis-Master by Coursework |
| Language: | English |
| Published: |
Nanyang Technological University
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/181597 |
| _version_ | 1824454721069383680 |
|---|---|
| author | Fang, Zhuohao |
| author2 | Na Jin Cheon |
| author_facet | Na Jin Cheon Fang, Zhuohao |
| author_sort | Fang, Zhuohao |
| collection | NTU |
| description | This dissertation explores feature fusion by combining RoBERTa and Knowledge Graph (KG) techniques using Gated Units to improve the accuracy of fake news detection. In text processing, RoBERTa model is able to understand and classify false content effectively due to its pre-training advantage. On the other hand, knowledge graphs provide rich semantic information in revealing the entities and relationships behind news content, which is crucial for verifying news authenticity.
Firstly, this study trains and evaluates the model using the PHEME dataset, and compares the effects of using RoBERTa alone, the knowledge graph alone (processed by TF-IDF and graph neural network (GNN) methods), and their fusion effects. The results show that RoBERTa has the highest accuracy when used alone, emphasizing the power of the pre-trained model for textual semantic understanding. However, when knowledge graph processing is introduced, especially through the GNN approach, it is able to provide a deeper understanding of entity relationships despite longer processing times, which in some cases contributes to improved detection accuracy.
Through comparative experiments, this paper confirms the effectiveness of feature fusion strategies in fake news detection and explores the trade-offs between different feature processing methods. In addition, this study points out the limitations of the current approach in terms of data diversity and model generalization, providing directions for improvement in future research.
Overall, This dissertation proposes an innovative feature fusion framework that combines features from the text after processing by a pre-trained model (Roberta) and external knowledge from the Knowledge Graph to improve the performance of fake news detection; investigates the Knowledge Graph feature extraction method and improves the utilization of external knowledge by constructing a new graph structure; explores feature fusion strategies and uses the gating unit to improve the ability of model feature fusion. Through these contributions, this research provides new ideas and directions for the field of fake news detection. |
| first_indexed | 2025-02-19T03:26:48Z |
| format | Thesis-Master by Coursework |
| id | ntu-10356/181597 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2025-02-19T03:26:48Z |
| publishDate | 2024 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1815972024-12-15T15:36:30Z Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating Fang, Zhuohao Na Jin Cheon Wee Kim Wee School of Communication and Information TJCNa@ntu.edu.sg Computer and Information Science Fake news detection RoBERTa Knowledge graph Feature fusion Gated units This dissertation explores feature fusion by combining RoBERTa and Knowledge Graph (KG) techniques using Gated Units to improve the accuracy of fake news detection. In text processing, RoBERTa model is able to understand and classify false content effectively due to its pre-training advantage. On the other hand, knowledge graphs provide rich semantic information in revealing the entities and relationships behind news content, which is crucial for verifying news authenticity. Firstly, this study trains and evaluates the model using the PHEME dataset, and compares the effects of using RoBERTa alone, the knowledge graph alone (processed by TF-IDF and graph neural network (GNN) methods), and their fusion effects. The results show that RoBERTa has the highest accuracy when used alone, emphasizing the power of the pre-trained model for textual semantic understanding. However, when knowledge graph processing is introduced, especially through the GNN approach, it is able to provide a deeper understanding of entity relationships despite longer processing times, which in some cases contributes to improved detection accuracy. Through comparative experiments, this paper confirms the effectiveness of feature fusion strategies in fake news detection and explores the trade-offs between different feature processing methods. In addition, this study points out the limitations of the current approach in terms of data diversity and model generalization, providing directions for improvement in future research. Overall, This dissertation proposes an innovative feature fusion framework that combines features from the text after processing by a pre-trained model (Roberta) and external knowledge from the Knowledge Graph to improve the performance of fake news detection; investigates the Knowledge Graph feature extraction method and improves the utilization of external knowledge by constructing a new graph structure; explores feature fusion strategies and uses the gating unit to improve the ability of model feature fusion. Through these contributions, this research provides new ideas and directions for the field of fake news detection. Master's degree 2024-12-10T07:23:41Z 2024-12-10T07:23:41Z 2024 Thesis-Master by Coursework Fang, Z. (2024). Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/181597 https://hdl.handle.net/10356/181597 en application/pdf Nanyang Technological University |
| spellingShingle | Computer and Information Science Fake news detection RoBERTa Knowledge graph Feature fusion Gated units Fang, Zhuohao Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating |
| title | Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating |
| title_full | Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating |
| title_fullStr | Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating |
| title_full_unstemmed | Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating |
| title_short | Fake news detection through feature fusion: Leveraging RoBERTa and knowledge graphs with gating |
| title_sort | fake news detection through feature fusion leveraging roberta and knowledge graphs with gating |
| topic | Computer and Information Science Fake news detection RoBERTa Knowledge graph Feature fusion Gated units |
| url | https://hdl.handle.net/10356/181597 |
| work_keys_str_mv | AT fangzhuohao fakenewsdetectionthroughfeaturefusionleveragingrobertaandknowledgegraphswithgating |