Improving representation learning on graph-structural data for classification, generation, and recommendation

This thesis explores innovative approaches in graph representation learning and its applications using deep learning models, making significant contributions across several key areas. We first introduce the Graph Meta-Contrast (GMeCo) framework, a novel meta-learning framework for contrastive repres...

Full description

Bibliographic Details
Main Author: Luo, Tianze
Other Authors: Sinno Jialin Pan
Format: Thesis-Doctor of Philosophy
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/179453
_version_ 1826114649626509312
author Luo, Tianze
author2 Sinno Jialin Pan
author_facet Sinno Jialin Pan
Luo, Tianze
author_sort Luo, Tianze
collection NTU
description This thesis explores innovative approaches in graph representation learning and its applications using deep learning models, making significant contributions across several key areas. We first introduce the Graph Meta-Contrast (GMeCo) framework, a novel meta-learning framework for contrastive representation learning on graphs. GMeCo effectively generates augmented graphs and maximizes the mutual information between the augmented graphs and input graphs, outperforming current methods in robust and discriminative feature learning. Next, we present the Multiresolution Meta-Framelet-based Graph Convolutional Network (MM-FGCN) model. This model represents an advancement in adaptive multiresolution analysis of graphs, overcoming fixed transform limitations and dynamically handling graph data at various scales. MM-FGCN's ability to capture both micro- and macro-level graph structures shows its superiority in various graph learning tasks. Furthermore, we introduce Graph Spectral Diffusion Model (GSDM), a novel approach for graph-structured data generation. GSDM utilizes low-rank diffusion Stochastic Differential Equations in graph spectrum space, enhancing graph topology generation and reducing computational load. This method demonstrates improved efficiency and quality in graph generation compared to existing models. Lastly, we develop a novel framework for sequential recommendation systems through a multi-view approach, combining Graph Neural Networks (GNNs) and Transformers. This multi-view structure leverages user-item interactions and collaborative information, offering robust and accurate user preference predictions. This model demonstrates its effectiveness over traditional models. Overall, this thesis presents effective methods and models in graph representation learning, contributing to advancements in the field and laying a foundation for future research in graph-based deep learning applications.
first_indexed 2024-10-01T03:42:55Z
format Thesis-Doctor of Philosophy
id ntu-10356/179453
institution Nanyang Technological University
language English
last_indexed 2024-10-01T03:42:55Z
publishDate 2024
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1794532024-09-04T07:56:36Z Improving representation learning on graph-structural data for classification, generation, and recommendation Luo, Tianze Sinno Jialin Pan College of Computing and Data Science sinnopan@ntu.edu.sg Computer and Information Science Graph representation learning Graph generation Recommender systems This thesis explores innovative approaches in graph representation learning and its applications using deep learning models, making significant contributions across several key areas. We first introduce the Graph Meta-Contrast (GMeCo) framework, a novel meta-learning framework for contrastive representation learning on graphs. GMeCo effectively generates augmented graphs and maximizes the mutual information between the augmented graphs and input graphs, outperforming current methods in robust and discriminative feature learning. Next, we present the Multiresolution Meta-Framelet-based Graph Convolutional Network (MM-FGCN) model. This model represents an advancement in adaptive multiresolution analysis of graphs, overcoming fixed transform limitations and dynamically handling graph data at various scales. MM-FGCN's ability to capture both micro- and macro-level graph structures shows its superiority in various graph learning tasks. Furthermore, we introduce Graph Spectral Diffusion Model (GSDM), a novel approach for graph-structured data generation. GSDM utilizes low-rank diffusion Stochastic Differential Equations in graph spectrum space, enhancing graph topology generation and reducing computational load. This method demonstrates improved efficiency and quality in graph generation compared to existing models. Lastly, we develop a novel framework for sequential recommendation systems through a multi-view approach, combining Graph Neural Networks (GNNs) and Transformers. This multi-view structure leverages user-item interactions and collaborative information, offering robust and accurate user preference predictions. This model demonstrates its effectiveness over traditional models. Overall, this thesis presents effective methods and models in graph representation learning, contributing to advancements in the field and laying a foundation for future research in graph-based deep learning applications. Doctor of Philosophy 2024-08-01T06:16:36Z 2024-08-01T06:16:36Z 2024 Thesis-Doctor of Philosophy Luo, T. (2024). Improving representation learning on graph-structural data for classification, generation, and recommendation. Doctoral thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/179453 https://hdl.handle.net/10356/179453 10.32657/10356/179453 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University
spellingShingle Computer and Information Science
Graph representation learning
Graph generation
Recommender systems
Luo, Tianze
Improving representation learning on graph-structural data for classification, generation, and recommendation
title Improving representation learning on graph-structural data for classification, generation, and recommendation
title_full Improving representation learning on graph-structural data for classification, generation, and recommendation
title_fullStr Improving representation learning on graph-structural data for classification, generation, and recommendation
title_full_unstemmed Improving representation learning on graph-structural data for classification, generation, and recommendation
title_short Improving representation learning on graph-structural data for classification, generation, and recommendation
title_sort improving representation learning on graph structural data for classification generation and recommendation
topic Computer and Information Science
Graph representation learning
Graph generation
Recommender systems
url https://hdl.handle.net/10356/179453
work_keys_str_mv AT luotianze improvingrepresentationlearningongraphstructuraldataforclassificationgenerationandrecommendation