Self-attention-based BGRU and CNN for Sentiment Analysis
Text sentiment analysis is a hot field in natural language processing.In recent years,Chinese text sentiment analysis methods have been widely investigated.Most of the recurrent neural network and convolutional neural network models based on word vectors have insufficient ability to extract and reta...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial office of Computer Science
2022-01-01
|
| Series: | Jisuanji kexue |
| Subjects: | |
| Online Access: | https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-1-252.pdf |
| _version_ | 1818995714513960960 |
|---|---|
| author | HU Yan-li, TONG Tan-qian, ZHANG Xiao-yu, PENG Juan |
| author_facet | HU Yan-li, TONG Tan-qian, ZHANG Xiao-yu, PENG Juan |
| author_sort | HU Yan-li, TONG Tan-qian, ZHANG Xiao-yu, PENG Juan |
| collection | DOAJ |
| description | Text sentiment analysis is a hot field in natural language processing.In recent years,Chinese text sentiment analysis methods have been widely investigated.Most of the recurrent neural network and convolutional neural network models based on word vectors have insufficient ability to extract and retain text features.In this paper,a Chinese sentiment polarity analysis model combining bi-directional GRU (BGRU) and multi-scale CNN is proposed.First,BGRU is utilized to extract text serialization features filtered with attention mechanism.Then the convolution neural network with distinct convolution kernels is applied to attention mechanism to adjust the dynamic weights.The text is acquired by the Softmax emotional polarity.Experiments indicates that our model outperforms the state-of-the-art methods on Chinese datasets.The accuracy of sentiment classification is 92.94% on the online_shopping_10_cats dataset of ChineseNLPcorpus,and 92.75% on the hotel review dataset compiled by Tan Songbo of Chinese Academy of Sciences,which is significantly improved compared with the current mainstream methods. |
| first_indexed | 2024-12-20T21:18:14Z |
| format | Article |
| id | doaj.art-2e759b49bd2f4f8cbf63dc4657d55815 |
| institution | Directory Open Access Journal |
| issn | 1002-137X |
| language | zho |
| last_indexed | 2024-12-20T21:18:14Z |
| publishDate | 2022-01-01 |
| publisher | Editorial office of Computer Science |
| record_format | Article |
| series | Jisuanji kexue |
| spelling | doaj.art-2e759b49bd2f4f8cbf63dc4657d558152022-12-21T19:26:22ZzhoEditorial office of Computer ScienceJisuanji kexue1002-137X2022-01-0149125225810.11896/jsjkx.210600063Self-attention-based BGRU and CNN for Sentiment AnalysisHU Yan-li, TONG Tan-qian, ZHANG Xiao-yu, PENG Juan0Science and Technology on Information Systems Engineering Laboratory,National University of Defense Technology,Changsha 410073,ChinaText sentiment analysis is a hot field in natural language processing.In recent years,Chinese text sentiment analysis methods have been widely investigated.Most of the recurrent neural network and convolutional neural network models based on word vectors have insufficient ability to extract and retain text features.In this paper,a Chinese sentiment polarity analysis model combining bi-directional GRU (BGRU) and multi-scale CNN is proposed.First,BGRU is utilized to extract text serialization features filtered with attention mechanism.Then the convolution neural network with distinct convolution kernels is applied to attention mechanism to adjust the dynamic weights.The text is acquired by the Softmax emotional polarity.Experiments indicates that our model outperforms the state-of-the-art methods on Chinese datasets.The accuracy of sentiment classification is 92.94% on the online_shopping_10_cats dataset of ChineseNLPcorpus,and 92.75% on the hotel review dataset compiled by Tan Songbo of Chinese Academy of Sciences,which is significantly improved compared with the current mainstream methods.https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-1-252.pdfsentiment analysis|self-attention mechanism|bi-directional gated recurrent unit|multi-scale convolution neural network |
| spellingShingle | HU Yan-li, TONG Tan-qian, ZHANG Xiao-yu, PENG Juan Self-attention-based BGRU and CNN for Sentiment Analysis Jisuanji kexue sentiment analysis|self-attention mechanism|bi-directional gated recurrent unit|multi-scale convolution neural network |
| title | Self-attention-based BGRU and CNN for Sentiment Analysis |
| title_full | Self-attention-based BGRU and CNN for Sentiment Analysis |
| title_fullStr | Self-attention-based BGRU and CNN for Sentiment Analysis |
| title_full_unstemmed | Self-attention-based BGRU and CNN for Sentiment Analysis |
| title_short | Self-attention-based BGRU and CNN for Sentiment Analysis |
| title_sort | self attention based bgru and cnn for sentiment analysis |
| topic | sentiment analysis|self-attention mechanism|bi-directional gated recurrent unit|multi-scale convolution neural network |
| url | https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-1-252.pdf |
| work_keys_str_mv | AT huyanlitongtanqianzhangxiaoyupengjuan selfattentionbasedbgruandcnnforsentimentanalysis |