Dynamic knowledge graph embedding

The goal of this study was to explore existing knowledge graph embedding techniques to discover one suitable for the implementation of online learning where embeddings in the model can be updated with any changes in the knowledge graph without the need to retrain the model again from scratch. Emb...

Full description

Bibliographic Details
Main Author: Teo, Eugene Yu-jie
Other Authors: Arijit Khan
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/148782
_version_ 1824454216241905664
author Teo, Eugene Yu-jie
author2 Arijit Khan
author_facet Arijit Khan
Teo, Eugene Yu-jie
author_sort Teo, Eugene Yu-jie
collection NTU
description The goal of this study was to explore existing knowledge graph embedding techniques to discover one suitable for the implementation of online learning where embeddings in the model can be updated with any changes in the knowledge graph without the need to retrain the model again from scratch. Embedding a knowledge graph allows useful tasks such as prediction of links and classification of entities to be performed and this can lead to discovery of new facts within the knowledge graph. Many knowledge graphs are also updated frequently with new up to date information. However, current embedding techniques do not support online learning and having to retrain the model with every minute change in the knowledge graph is not time efficient and limits how useful each model is. Finding a way to implement online learning to a model should allow for significant time savings for updating of embeddings each time the knowledge graph is updated. We started by exploring and understanding different embedding techniques to determine which would lend themselves best to certain implementations of online learning. We then did some experimentation with selected models to test the feasibility of online learning. We gathered the design for each model from the paper released proposing the method and the implementation from their respective GitHub. We discovered a potential candidate in R-GCN that could lend itself to implementation of online learning given the correct dataset and some testing and tweaking in the future for better overall performance. More experimentation and development is required to test our current initial findings.
first_indexed 2025-02-19T03:18:47Z
format Final Year Project (FYP)
id ntu-10356/148782
institution Nanyang Technological University
language English
last_indexed 2025-02-19T03:18:47Z
publishDate 2021
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1487822021-05-17T12:51:35Z Dynamic knowledge graph embedding Teo, Eugene Yu-jie Arijit Khan School of Computer Science and Engineering arijit.khan@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence The goal of this study was to explore existing knowledge graph embedding techniques to discover one suitable for the implementation of online learning where embeddings in the model can be updated with any changes in the knowledge graph without the need to retrain the model again from scratch. Embedding a knowledge graph allows useful tasks such as prediction of links and classification of entities to be performed and this can lead to discovery of new facts within the knowledge graph. Many knowledge graphs are also updated frequently with new up to date information. However, current embedding techniques do not support online learning and having to retrain the model with every minute change in the knowledge graph is not time efficient and limits how useful each model is. Finding a way to implement online learning to a model should allow for significant time savings for updating of embeddings each time the knowledge graph is updated. We started by exploring and understanding different embedding techniques to determine which would lend themselves best to certain implementations of online learning. We then did some experimentation with selected models to test the feasibility of online learning. We gathered the design for each model from the paper released proposing the method and the implementation from their respective GitHub. We discovered a potential candidate in R-GCN that could lend itself to implementation of online learning given the correct dataset and some testing and tweaking in the future for better overall performance. More experimentation and development is required to test our current initial findings. Bachelor of Engineering (Computer Science) 2021-05-17T12:51:35Z 2021-05-17T12:51:35Z 2021 Final Year Project (FYP) Teo, E. Y. (2021). Dynamic knowledge graph embedding. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/148782 https://hdl.handle.net/10356/148782 en SCSE20-0024 application/pdf Nanyang Technological University
spellingShingle Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
Teo, Eugene Yu-jie
Dynamic knowledge graph embedding
title Dynamic knowledge graph embedding
title_full Dynamic knowledge graph embedding
title_fullStr Dynamic knowledge graph embedding
title_full_unstemmed Dynamic knowledge graph embedding
title_short Dynamic knowledge graph embedding
title_sort dynamic knowledge graph embedding
topic Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence
url https://hdl.handle.net/10356/148782
work_keys_str_mv AT teoeugeneyujie dynamicknowledgegraphembedding