Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information
The aim of aspect based sentiment analysis (ABSA) is to classify the sentiment polarity towards a particular aspect in a sentence. Existing approaches usually apply attention mechanism to modeling the connection between aspects and opinion expression in an implicit way. However, they ignore the pote...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
2022-02-01
|
| Series: | Jisuanji kexue yu tansuo |
| Subjects: | |
| Online Access: | http://fcst.ceaj.org/fileup/1673-9418/PDF/2009003.pdf |
| _version_ | 1819277512464662528 |
|---|---|
| author | XIAO Zeguan, CHEN Qingliang |
| author_facet | XIAO Zeguan, CHEN Qingliang |
| author_sort | XIAO Zeguan, CHEN Qingliang |
| collection | DOAJ |
| description | The aim of aspect based sentiment analysis (ABSA) is to classify the sentiment polarity towards a particular aspect in a sentence. Existing approaches usually apply attention mechanism to modeling the connection between aspects and opinion expression in an implicit way. However, they ignore the potentially useful grammatical information. On one hand, the sentiment polarity of an aspect is closely related to opinion expression, and syntactic information helps to better model the relation of them. On the other hand, models are hard to learn general grammatical knowledge when trained on existing small benchmark datasets, resulting in difficulty to handle complex sentence patterns and opinion expressions. To address the problem, this paper proposes a neural network that combines various kinds of grammatical information to enhance the accuracy. This paper employs dependency tree based graph convolutional networks (GCN) to match aspects and their corresponding opinion expression directly using syntactic information and eliminate useless information. This paper also uses middle layers of BERT as guiding information to enhance the model, which contains various kinds of contextual and grammatical information. The input of each GCN layer fuses the output of the preceding GCN layer and BERT (bidirectional encoder representations from transformers) middle layers. Finally, the aspect representation of the last layer GCN is used as the feature to identify sentiment polarity. Experiments on SemEval 2014 Task4 Restaurant, Laptop and Twitter show the model outperforms other baselines. |
| first_indexed | 2024-12-23T23:57:18Z |
| format | Article |
| id | doaj.art-8354c6c567024bd9820d18c96e35ea09 |
| institution | Directory Open Access Journal |
| issn | 1673-9418 |
| language | zho |
| last_indexed | 2024-12-23T23:57:18Z |
| publishDate | 2022-02-01 |
| publisher | Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press |
| record_format | Article |
| series | Jisuanji kexue yu tansuo |
| spelling | doaj.art-8354c6c567024bd9820d18c96e35ea092022-12-21T17:25:13ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182022-02-0116239540210.3778/j.issn.1673-9418.2009003Aspect-Based Sentiment Analysis Model with Multiple Grammatical InformationXIAO Zeguan, CHEN Qingliang01. Department of Computer Science, Jinan University, Guangzhou 510632, China;2. Yunqu-Jinan University Joint AI Research Center, Guangzhou 510632, ChinaThe aim of aspect based sentiment analysis (ABSA) is to classify the sentiment polarity towards a particular aspect in a sentence. Existing approaches usually apply attention mechanism to modeling the connection between aspects and opinion expression in an implicit way. However, they ignore the potentially useful grammatical information. On one hand, the sentiment polarity of an aspect is closely related to opinion expression, and syntactic information helps to better model the relation of them. On the other hand, models are hard to learn general grammatical knowledge when trained on existing small benchmark datasets, resulting in difficulty to handle complex sentence patterns and opinion expressions. To address the problem, this paper proposes a neural network that combines various kinds of grammatical information to enhance the accuracy. This paper employs dependency tree based graph convolutional networks (GCN) to match aspects and their corresponding opinion expression directly using syntactic information and eliminate useless information. This paper also uses middle layers of BERT as guiding information to enhance the model, which contains various kinds of contextual and grammatical information. The input of each GCN layer fuses the output of the preceding GCN layer and BERT (bidirectional encoder representations from transformers) middle layers. Finally, the aspect representation of the last layer GCN is used as the feature to identify sentiment polarity. Experiments on SemEval 2014 Task4 Restaurant, Laptop and Twitter show the model outperforms other baselines.http://fcst.ceaj.org/fileup/1673-9418/PDF/2009003.pdf|aspect|sentiment analysis|bidirectional encoder representations from transformers (bert)|dependency tree|graph convolutional networks (gcn) |
| spellingShingle | XIAO Zeguan, CHEN Qingliang Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information Jisuanji kexue yu tansuo |aspect|sentiment analysis|bidirectional encoder representations from transformers (bert)|dependency tree|graph convolutional networks (gcn) |
| title | Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information |
| title_full | Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information |
| title_fullStr | Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information |
| title_full_unstemmed | Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information |
| title_short | Aspect-Based Sentiment Analysis Model with Multiple Grammatical Information |
| title_sort | aspect based sentiment analysis model with multiple grammatical information |
| topic | |aspect|sentiment analysis|bidirectional encoder representations from transformers (bert)|dependency tree|graph convolutional networks (gcn) |
| url | http://fcst.ceaj.org/fileup/1673-9418/PDF/2009003.pdf |
| work_keys_str_mv | AT xiaozeguanchenqingliang aspectbasedsentimentanalysismodelwithmultiplegrammaticalinformation |