Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning
As an effective representation model of the real world knowledge, knowledge base (or knowledge graph) has attracted wide attention from academia and industry. In recent years, with the emergence of large-scale knowledge bases, knowledge base question answering has also attracted attention as a basic...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
2021-10-01
|
| Series: | Jisuanji kexue yu tansuo |
| Subjects: | |
| Online Access: | http://fcst.ceaj.org/CN/abstract/abstract2910.shtml |
| _version_ | 1818718544417783808 |
|---|---|
| author | CHEN Ziyang, LIAO Jinzhi, ZHAO Xiang, CHEN Yingguo |
| author_facet | CHEN Ziyang, LIAO Jinzhi, ZHAO Xiang, CHEN Yingguo |
| author_sort | CHEN Ziyang, LIAO Jinzhi, ZHAO Xiang, CHEN Yingguo |
| collection | DOAJ |
| description | As an effective representation model of the real world knowledge, knowledge base (or knowledge graph) has attracted wide attention from academia and industry. In recent years, with the emergence of large-scale knowledge bases, knowledge base question answering has also attracted attention as a basic application technology of knowledge bases. Among them, the typical method based on semantic parsing transforms questions into answer retrieval on graphs by parsing query sentences, however, which neglects that there are often missing links in knowledge bases. As a result, the above process might fall short in some cases. The typical model based on neural reasoning performs entity similarity ranking by encoding questions, but it cannot solve the cold start problem of given entities in dynamic scenarios. To address the above problems, a neural inference knowledge base question-and-answer method incorporating subgraph structures is proposed to achieve a more adequate inference by taking into account the semantic and structural information of entities in the question-and-answer inference process. Firstly, the question and answer are converted into vectors containing semantic information by the pre-training model RoBERTa. Secondly, the corresponding question and answer subgraphs are constructed based on the entities in the question and answer, and the structural information of the subgraphs is extracted using graph neural networks. Then, the entity representations are pre-trained based on the background knowledge base and fused with the corresponding structural representations. Finally, the candidate answers are rated based on the fused vectors, and the entity with the highest rating is considered as the answer. Extensive experiments are conducted on the WebQuestionsSP dataset, and the experimental results show that the proposed model outperforms other benchmark models. |
| first_indexed | 2024-12-17T19:52:44Z |
| format | Article |
| id | doaj.art-aa86d7beec934a868befc346bba5f3dc |
| institution | Directory Open Access Journal |
| issn | 1673-9418 |
| language | zho |
| last_indexed | 2024-12-17T19:52:44Z |
| publishDate | 2021-10-01 |
| publisher | Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press |
| record_format | Article |
| series | Jisuanji kexue yu tansuo |
| spelling | doaj.art-aa86d7beec934a868befc346bba5f3dc2022-12-21T21:34:41ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182021-10-0115101870187910.3778/j.issn.1673-9418.2106094Incorporating Subgraph Structure Knowledge Base Question Answering via Neural ReasoningCHEN Ziyang, LIAO Jinzhi, ZHAO Xiang, CHEN Yingguo0Science and Technology on Information Systems Engineering Laboratory, National University of Defense Technology, Changsha 410073, ChinaAs an effective representation model of the real world knowledge, knowledge base (or knowledge graph) has attracted wide attention from academia and industry. In recent years, with the emergence of large-scale knowledge bases, knowledge base question answering has also attracted attention as a basic application technology of knowledge bases. Among them, the typical method based on semantic parsing transforms questions into answer retrieval on graphs by parsing query sentences, however, which neglects that there are often missing links in knowledge bases. As a result, the above process might fall short in some cases. The typical model based on neural reasoning performs entity similarity ranking by encoding questions, but it cannot solve the cold start problem of given entities in dynamic scenarios. To address the above problems, a neural inference knowledge base question-and-answer method incorporating subgraph structures is proposed to achieve a more adequate inference by taking into account the semantic and structural information of entities in the question-and-answer inference process. Firstly, the question and answer are converted into vectors containing semantic information by the pre-training model RoBERTa. Secondly, the corresponding question and answer subgraphs are constructed based on the entities in the question and answer, and the structural information of the subgraphs is extracted using graph neural networks. Then, the entity representations are pre-trained based on the background knowledge base and fused with the corresponding structural representations. Finally, the candidate answers are rated based on the fused vectors, and the entity with the highest rating is considered as the answer. Extensive experiments are conducted on the WebQuestionsSP dataset, and the experimental results show that the proposed model outperforms other benchmark models.http://fcst.ceaj.org/CN/abstract/abstract2910.shtmlknowledge base question answeringneural reasoningsubgraph structuregraph convolutional network |
| spellingShingle | CHEN Ziyang, LIAO Jinzhi, ZHAO Xiang, CHEN Yingguo Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning Jisuanji kexue yu tansuo knowledge base question answering neural reasoning subgraph structure graph convolutional network |
| title | Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning |
| title_full | Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning |
| title_fullStr | Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning |
| title_full_unstemmed | Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning |
| title_short | Incorporating Subgraph Structure Knowledge Base Question Answering via Neural Reasoning |
| title_sort | incorporating subgraph structure knowledge base question answering via neural reasoning |
| topic | knowledge base question answering neural reasoning subgraph structure graph convolutional network |
| url | http://fcst.ceaj.org/CN/abstract/abstract2910.shtml |
| work_keys_str_mv | AT chenziyangliaojinzhizhaoxiangchenyingguo incorporatingsubgraphstructureknowledgebasequestionansweringvianeuralreasoning |