A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems

Text classification is a classical task in natural language processing. Prior traditional text classification methods rely on manually extracted features to a great extent, which are easily influenced by human subjectivity. Some existing text classification methods based on the artificial neural net...

Full description

Bibliographic Details
Main Authors: Jiaqi Zhang, Xiyu Liu
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10184018/
_version_ 1797774905177014272
author Jiaqi Zhang
Xiyu Liu
author_facet Jiaqi Zhang
Xiyu Liu
author_sort Jiaqi Zhang
collection DOAJ
description Text classification is a classical task in natural language processing. Prior traditional text classification methods rely on manually extracted features to a great extent, which are easily influenced by human subjectivity. Some existing text classification methods based on the artificial neural networks sometimes neglect the contextual semantic relationships of discontinuous word sequences, resulting in poor learning results. To alleviate these problems, we propose an attention-based gated graph neural network in the framework of coupled P systems (CPGANN) to automatically extract feature representations of nodes. The gating unit with attention is introduced to aggregate neighbor information to capture context semantic relations, and effectively alleviate the long-term dependence on discontinuous words. In order to obtain more discriminative nodes for classification, the attention mechanism is employed in CPGANN to extract keyword nodes before readout to aggregate subgraph representations. Extensive experiments on four real-world datasets demonstrate that CPGANN outperforms all other state-of-the-art baseline algorithms.
first_indexed 2024-03-12T22:27:57Z
format Article
id doaj.art-bc671cc111d0452da8b84526a762c77f
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-12T22:27:57Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-bc671cc111d0452da8b84526a762c77f2023-07-21T23:01:19ZengIEEEIEEE Access2169-35362023-01-0111724487246110.1109/ACCESS.2023.329557210184018A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P SystemsJiaqi Zhang0https://orcid.org/0009-0007-2744-0902Xiyu Liu1https://orcid.org/0000-0003-4976-9227Business School, Shandong Normal University, Jinan, ChinaBusiness School, Shandong Normal University, Jinan, ChinaText classification is a classical task in natural language processing. Prior traditional text classification methods rely on manually extracted features to a great extent, which are easily influenced by human subjectivity. Some existing text classification methods based on the artificial neural networks sometimes neglect the contextual semantic relationships of discontinuous word sequences, resulting in poor learning results. To alleviate these problems, we propose an attention-based gated graph neural network in the framework of coupled P systems (CPGANN) to automatically extract feature representations of nodes. The gating unit with attention is introduced to aggregate neighbor information to capture context semantic relations, and effectively alleviate the long-term dependence on discontinuous words. In order to obtain more discriminative nodes for classification, the attention mechanism is employed in CPGANN to extract keyword nodes before readout to aggregate subgraph representations. Extensive experiments on four real-world datasets demonstrate that CPGANN outperforms all other state-of-the-art baseline algorithms.https://ieeexplore.ieee.org/document/10184018/Attention mechanismgraph neural networkP systemstext classification
spellingShingle Jiaqi Zhang
Xiyu Liu
A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems
IEEE Access
Attention mechanism
graph neural network
P systems
text classification
title A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems
title_full A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems
title_fullStr A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems
title_full_unstemmed A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems
title_short A Gated Graph Neural Network With Attention for Text Classification Based on Coupled P Systems
title_sort gated graph neural network with attention for text classification based on coupled p systems
topic Attention mechanism
graph neural network
P systems
text classification
url https://ieeexplore.ieee.org/document/10184018/
work_keys_str_mv AT jiaqizhang agatedgraphneuralnetworkwithattentionfortextclassificationbasedoncoupledpsystems
AT xiyuliu agatedgraphneuralnetworkwithattentionfortextclassificationbasedoncoupledpsystems
AT jiaqizhang gatedgraphneuralnetworkwithattentionfortextclassificationbasedoncoupledpsystems
AT xiyuliu gatedgraphneuralnetworkwithattentionfortextclassificationbasedoncoupledpsystems