Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model
Sentiment analysis of netizens’ comments can accurately grasp the psychology of netizens and reduce the risks brought by online public opinion. However, there is currently no effective method to solve the problems of short text, open word range, and sometimes reversed word order in comments. To bett...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
PeerJ Inc.
2022-06-01
|
| Series: | PeerJ Computer Science |
| Subjects: | |
| Online Access: | https://peerj.com/articles/cs-1005.pdf |
| _version_ | 1818545592293392384 |
|---|---|
| author | Xuchu Jiang Chao Song Yucheng Xu Ying Li Yili Peng |
| author_facet | Xuchu Jiang Chao Song Yucheng Xu Ying Li Yili Peng |
| author_sort | Xuchu Jiang |
| collection | DOAJ |
| description | Sentiment analysis of netizens’ comments can accurately grasp the psychology of netizens and reduce the risks brought by online public opinion. However, there is currently no effective method to solve the problems of short text, open word range, and sometimes reversed word order in comments. To better solve the above problems, this article proposes a hybrid model of sentiment classification, which is based on bidirectional encoder representations from transformers (BERT), bidirectional long short-term memory (BiLSTM) and a text convolution neural network (TextCNN) (BERT-BiLSTM-TextCNN). The experimental results show that (1) the hybrid model proposed in this article can better combine the advantages of BiLSTM and TextCNN; it not only captures local correlation while retaining context information but also has high accuracy and stability. (2) The BERT-BiLSTM-TextCNN model can extract important emotional information more flexibly in text and achieve multiclass classification tasks of emotions more accurately. The innovations of this study are as follows: (1) the use of BERT to generate word vectors has the advantages of more prior information and a full combination of contextual semantics; (2) the BiLSTM model, as a bidirectional context mechanism model, can obtain contextual information well; and (3) the TextCNN model can obtain important features well in the problem of text classification, and the combined effect of the three modules can significantly improve the accuracy of emotional multilabel classification. |
| first_indexed | 2024-12-12T07:42:08Z |
| format | Article |
| id | doaj.art-58a110e285134edca44fdada0a492cfe |
| institution | Directory Open Access Journal |
| issn | 2376-5992 |
| language | English |
| last_indexed | 2024-12-12T07:42:08Z |
| publishDate | 2022-06-01 |
| publisher | PeerJ Inc. |
| record_format | Article |
| series | PeerJ Computer Science |
| spelling | doaj.art-58a110e285134edca44fdada0a492cfe2022-12-22T00:32:45ZengPeerJ Inc.PeerJ Computer Science2376-59922022-06-018e100510.7717/peerj-cs.1005Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN modelXuchu Jiang0Chao Song1Yucheng Xu2Ying Li3Yili Peng4Zhongnan University of Economics and Law, Wuhan, Hubei, ChinaZhongnan University of Economics and Law, Wuhan, Hubei, ChinaZhongnan University of Economics and Law, Wuhan, Hubei, ChinaZhongnan University of Economics and Law, Wuhan, Hubei, ChinaWuhan Institute of Technology, Wuhan, Hubei, ChinaSentiment analysis of netizens’ comments can accurately grasp the psychology of netizens and reduce the risks brought by online public opinion. However, there is currently no effective method to solve the problems of short text, open word range, and sometimes reversed word order in comments. To better solve the above problems, this article proposes a hybrid model of sentiment classification, which is based on bidirectional encoder representations from transformers (BERT), bidirectional long short-term memory (BiLSTM) and a text convolution neural network (TextCNN) (BERT-BiLSTM-TextCNN). The experimental results show that (1) the hybrid model proposed in this article can better combine the advantages of BiLSTM and TextCNN; it not only captures local correlation while retaining context information but also has high accuracy and stability. (2) The BERT-BiLSTM-TextCNN model can extract important emotional information more flexibly in text and achieve multiclass classification tasks of emotions more accurately. The innovations of this study are as follows: (1) the use of BERT to generate word vectors has the advantages of more prior information and a full combination of contextual semantics; (2) the BiLSTM model, as a bidirectional context mechanism model, can obtain contextual information well; and (3) the TextCNN model can obtain important features well in the problem of text classification, and the combined effect of the three modules can significantly improve the accuracy of emotional multilabel classification.https://peerj.com/articles/cs-1005.pdfBERTBiLSTMTextCNNSentiment classification |
| spellingShingle | Xuchu Jiang Chao Song Yucheng Xu Ying Li Yili Peng Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model PeerJ Computer Science BERT BiLSTM TextCNN Sentiment classification |
| title | Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model |
| title_full | Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model |
| title_fullStr | Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model |
| title_full_unstemmed | Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model |
| title_short | Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model |
| title_sort | research on sentiment classification for netizens based on the bert bilstm textcnn model |
| topic | BERT BiLSTM TextCNN Sentiment classification |
| url | https://peerj.com/articles/cs-1005.pdf |
| work_keys_str_mv | AT xuchujiang researchonsentimentclassificationfornetizensbasedonthebertbilstmtextcnnmodel AT chaosong researchonsentimentclassificationfornetizensbasedonthebertbilstmtextcnnmodel AT yuchengxu researchonsentimentclassificationfornetizensbasedonthebertbilstmtextcnnmodel AT yingli researchonsentimentclassificationfornetizensbasedonthebertbilstmtextcnnmodel AT yilipeng researchonsentimentclassificationfornetizensbasedonthebertbilstmtextcnnmodel |