Causalqa: a causal framework for question answering
Neural networks have proven their success in various fundamental applications such as object detection, image segmentation, image and text generation and several NLP tasks. That said, neural networks are black-box function approximators with good approximation capability described by the universal a...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/156616 |
| _version_ | 1824455239198048256 |
|---|---|
| author | Dutta, Angshuk |
| author2 | Joty Shafiq Rayhan |
| author_facet | Joty Shafiq Rayhan Dutta, Angshuk |
| author_sort | Dutta, Angshuk |
| collection | NTU |
| description | Neural networks have proven their success in various fundamental applications such as object detection, image segmentation, image and text generation and several NLP tasks. That said, neural networks are black-box function approximators with good approximation capability described by the universal approximation theorem. This black box nature prevents the utilisation of neural networks in high risk areas such as healthcare. This brings a need for explainable AI. The paradigm used to explore these possibilities is causality.
In this work, we introduce a novel question answering algorithm dubbed CausalQA which learns several subtasks such as causal structure learning. Furthermore, we introduce an interventional training paradigm based on previous theoretical works including recent theoretical works on linking graph neural networks to Structural Causal Models. We show proof of concept by evaluating it on a toy dataset and further evaluating it on question answering datasets. We achieve comparable performance to state-of-the-art models and empirically prove the ability. |
| first_indexed | 2025-02-19T03:35:03Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/156616 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2025-02-19T03:35:03Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1566162022-04-21T05:36:02Z Causalqa: a causal framework for question answering Dutta, Angshuk Joty Shafiq Rayhan School of Computer Science and Engineering srjoty@ntu.edu.sg Engineering::Computer science and engineering Neural networks have proven their success in various fundamental applications such as object detection, image segmentation, image and text generation and several NLP tasks. That said, neural networks are black-box function approximators with good approximation capability described by the universal approximation theorem. This black box nature prevents the utilisation of neural networks in high risk areas such as healthcare. This brings a need for explainable AI. The paradigm used to explore these possibilities is causality. In this work, we introduce a novel question answering algorithm dubbed CausalQA which learns several subtasks such as causal structure learning. Furthermore, we introduce an interventional training paradigm based on previous theoretical works including recent theoretical works on linking graph neural networks to Structural Causal Models. We show proof of concept by evaluating it on a toy dataset and further evaluating it on question answering datasets. We achieve comparable performance to state-of-the-art models and empirically prove the ability. Bachelor of Science in Data Science and Artificial Intelligence 2022-04-21T05:36:02Z 2022-04-21T05:36:02Z 2022 Final Year Project (FYP) Dutta, A. (2022). Causalqa: a causal framework for question answering. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156616 https://hdl.handle.net/10356/156616 en SCSE21-0526 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering Dutta, Angshuk Causalqa: a causal framework for question answering |
| title | Causalqa: a causal framework for question answering |
| title_full | Causalqa: a causal framework for question answering |
| title_fullStr | Causalqa: a causal framework for question answering |
| title_full_unstemmed | Causalqa: a causal framework for question answering |
| title_short | Causalqa: a causal framework for question answering |
| title_sort | causalqa a causal framework for question answering |
| topic | Engineering::Computer science and engineering |
| url | https://hdl.handle.net/10356/156616 |
| work_keys_str_mv | AT duttaangshuk causalqaacausalframeworkforquestionanswering |