MBHAN: Motif-Based Heterogeneous Graph Attention Network

Graph neural networks are graph-based deep learning technologies that have attracted significant attention from researchers because of their powerful performance. Heterogeneous graph-based graph neural networks focus on the heterogeneity of the nodes and links in a graph. This is more effective at p...

Full description

Bibliographic Details
Main Authors: Qian Hu, Weiping Lin, Minli Tang, Jiatao Jiang
Format: Article
Language:English
Published: MDPI AG 2022-06-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/12/12/5931
_version_ 1797490346334093312
author Qian Hu
Weiping Lin
Minli Tang
Jiatao Jiang
author_facet Qian Hu
Weiping Lin
Minli Tang
Jiatao Jiang
author_sort Qian Hu
collection DOAJ
description Graph neural networks are graph-based deep learning technologies that have attracted significant attention from researchers because of their powerful performance. Heterogeneous graph-based graph neural networks focus on the heterogeneity of the nodes and links in a graph. This is more effective at preserving semantic knowledge when representing data interactions in real-world graph structures. Unfortunately, most heterogeneous graph neural networks tend to transform heterogeneous graphs into homogeneous graphs when using meta-paths for representation learning. This paper therefore presents a novel motif-based hierarchical heterogeneous graph attention network algorithm, MBHAN, that addresses this problem by incorporating a hierarchical dual attention mechanism at the node-level and motif-level. Node-level attention aims to learn the importance between a node and its neighboring nodes within its corresponding motif. Motif-level attention is capable of learning the importance of different motifs in the heterogeneous graph. In view of the different vector space features of different types of nodes in heterogeneous graphs, MBHAN also aggregates the features of different types of nodes, so that they can jointly participate in downstream tasks after passing through segregated independent shallow neural networks. MBHAN’s superior network representation learning capability has been validated by extensive experiments on two real-world datasets.
first_indexed 2024-03-10T00:31:40Z
format Article
id doaj.art-95202650abe949c4978fe496b669eede
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T00:31:40Z
publishDate 2022-06-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-95202650abe949c4978fe496b669eede2023-11-23T15:24:50ZengMDPI AGApplied Sciences2076-34172022-06-011212593110.3390/app12125931MBHAN: Motif-Based Heterogeneous Graph Attention NetworkQian Hu0Weiping Lin1Minli Tang2Jiatao Jiang3School of Media and Communications, Guizhou Normal University, Guiyang 550000, ChinaSchool of Informatics, Xiamen University, Xiamen 361000, ChinaSchool of Informatics, Xiamen University, Xiamen 361000, ChinaSchool of mathematical Science, Guizhou Normal University, Guiyang 550000, ChinaGraph neural networks are graph-based deep learning technologies that have attracted significant attention from researchers because of their powerful performance. Heterogeneous graph-based graph neural networks focus on the heterogeneity of the nodes and links in a graph. This is more effective at preserving semantic knowledge when representing data interactions in real-world graph structures. Unfortunately, most heterogeneous graph neural networks tend to transform heterogeneous graphs into homogeneous graphs when using meta-paths for representation learning. This paper therefore presents a novel motif-based hierarchical heterogeneous graph attention network algorithm, MBHAN, that addresses this problem by incorporating a hierarchical dual attention mechanism at the node-level and motif-level. Node-level attention aims to learn the importance between a node and its neighboring nodes within its corresponding motif. Motif-level attention is capable of learning the importance of different motifs in the heterogeneous graph. In view of the different vector space features of different types of nodes in heterogeneous graphs, MBHAN also aggregates the features of different types of nodes, so that they can jointly participate in downstream tasks after passing through segregated independent shallow neural networks. MBHAN’s superior network representation learning capability has been validated by extensive experiments on two real-world datasets.https://www.mdpi.com/2076-3417/12/12/5931heterogeneous graphsgraph neural networksrepresentation learningmotifattention mechanism
spellingShingle Qian Hu
Weiping Lin
Minli Tang
Jiatao Jiang
MBHAN: Motif-Based Heterogeneous Graph Attention Network
Applied Sciences
heterogeneous graphs
graph neural networks
representation learning
motif
attention mechanism
title MBHAN: Motif-Based Heterogeneous Graph Attention Network
title_full MBHAN: Motif-Based Heterogeneous Graph Attention Network
title_fullStr MBHAN: Motif-Based Heterogeneous Graph Attention Network
title_full_unstemmed MBHAN: Motif-Based Heterogeneous Graph Attention Network
title_short MBHAN: Motif-Based Heterogeneous Graph Attention Network
title_sort mbhan motif based heterogeneous graph attention network
topic heterogeneous graphs
graph neural networks
representation learning
motif
attention mechanism
url https://www.mdpi.com/2076-3417/12/12/5931
work_keys_str_mv AT qianhu mbhanmotifbasedheterogeneousgraphattentionnetwork
AT weipinglin mbhanmotifbasedheterogeneousgraphattentionnetwork
AT minlitang mbhanmotifbasedheterogeneousgraphattentionnetwork
AT jiataojiang mbhanmotifbasedheterogeneousgraphattentionnetwork