English exam question answering using a deep learning model
In the natural language processing research field, many efforts have been devoted into reading comprehension tasks and deep learning has garnered interests over the recent years, with many different models developed to demonstrate the machine’s ability to compete with humans on the same given task....
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
2018
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/10356/74141 |
| _version_ | 1811686453823930368 |
|---|---|
| author | Sokhonn, Rainy |
| author2 | Hui Siu Cheung |
| author_facet | Hui Siu Cheung Sokhonn, Rainy |
| author_sort | Sokhonn, Rainy |
| collection | NTU |
| description | In the natural language processing research field, many efforts have been devoted into reading comprehension tasks and deep learning has garnered interests over the recent years, with many different models developed to demonstrate the machine’s ability to compete with humans on the same given task. In order to develop such an intelligent model, a dataset with a high level of reasoning complexity needs to be addressed, along with a well-suited training model which performs significantly well on the given task.
Many studies have been conducted on different reading comprehension tasks and the presence of well-performing models such as Bi-DAF can be seen. However, one of the most challenging tasks, namely the RACE dataset, still has a limited number of studies related to it, due to its nature as a large-scale dataset and intense requirement of complex reasoning. Hence, a detailed study on this dataset can be conducted in order to look into different factors with the purpose of improving the results.
This project aims to improve the result on this particular English reading comprehension task, by choosing the large-scale RACE dataset and improving the baseline model. The study discusses various concepts in layer modeling and attention mechanisms chosen from other well-performing models.
Ultimately, even though the study achieves a relatively acceptable result comparing to some baseline models, it is still relatively behind some newly developed concepts and has many rooms for improvements. A further discussion on the limitations of the developed models can contribute to better results in the future. |
| first_indexed | 2024-10-01T05:00:40Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/74141 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:00:40Z |
| publishDate | 2018 |
| record_format | dspace |
| spelling | ntu-10356/741412023-03-03T20:49:46Z English exam question answering using a deep learning model Sokhonn, Rainy Hui Siu Cheung School of Computer Science and Engineering DRNTU::Engineering::Computer science and engineering::Computing methodologies::Document and text processing DRNTU::Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence In the natural language processing research field, many efforts have been devoted into reading comprehension tasks and deep learning has garnered interests over the recent years, with many different models developed to demonstrate the machine’s ability to compete with humans on the same given task. In order to develop such an intelligent model, a dataset with a high level of reasoning complexity needs to be addressed, along with a well-suited training model which performs significantly well on the given task. Many studies have been conducted on different reading comprehension tasks and the presence of well-performing models such as Bi-DAF can be seen. However, one of the most challenging tasks, namely the RACE dataset, still has a limited number of studies related to it, due to its nature as a large-scale dataset and intense requirement of complex reasoning. Hence, a detailed study on this dataset can be conducted in order to look into different factors with the purpose of improving the results. This project aims to improve the result on this particular English reading comprehension task, by choosing the large-scale RACE dataset and improving the baseline model. The study discusses various concepts in layer modeling and attention mechanisms chosen from other well-performing models. Ultimately, even though the study achieves a relatively acceptable result comparing to some baseline models, it is still relatively behind some newly developed concepts and has many rooms for improvements. A further discussion on the limitations of the developed models can contribute to better results in the future. Bachelor of Engineering (Computer Science) 2018-04-30T00:24:15Z 2018-04-30T00:24:15Z 2018 Final Year Project (FYP) http://hdl.handle.net/10356/74141 en Nanyang Technological University 53 p. application/pdf |
| spellingShingle | DRNTU::Engineering::Computer science and engineering::Computing methodologies::Document and text processing DRNTU::Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Sokhonn, Rainy English exam question answering using a deep learning model |
| title | English exam question answering using a deep learning model |
| title_full | English exam question answering using a deep learning model |
| title_fullStr | English exam question answering using a deep learning model |
| title_full_unstemmed | English exam question answering using a deep learning model |
| title_short | English exam question answering using a deep learning model |
| title_sort | english exam question answering using a deep learning model |
| topic | DRNTU::Engineering::Computer science and engineering::Computing methodologies::Document and text processing DRNTU::Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence |
| url | http://hdl.handle.net/10356/74141 |
| work_keys_str_mv | AT sokhonnrainy englishexamquestionansweringusingadeeplearningmodel |