A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension
In order to solve the problem that traditional short text classification methods do not perform well on short text due to the data sparsity and insufficient semantic features, we propose a short text classification method based on convolutional neural network and semantic extension. Firstly, we prop...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer
2020-12-01
|
| Series: | International Journal of Computational Intelligence Systems |
| Subjects: | |
| Online Access: | https://www.atlantis-press.com/article/125948353/view |
| _version_ | 1811302070480797696 |
|---|---|
| author | Haitao Wang Keke Tian Zhengjiang Wu Lei Wang |
| author_facet | Haitao Wang Keke Tian Zhengjiang Wu Lei Wang |
| author_sort | Haitao Wang |
| collection | DOAJ |
| description | In order to solve the problem that traditional short text classification methods do not perform well on short text due to the data sparsity and insufficient semantic features, we propose a short text classification method based on convolutional neural network and semantic extension. Firstly, we propose an improved similarity to improve the coverage of the word vector table in the short text preprocessing process. Secondly, we propose a method for semantic expansion of short texts, which adding an attention mechanism to the neural network model to find related words in the short text, and semantic expansion is performed at the sentence level and the related word level of the short text respectively. Finally, the feature extraction of short text is carried out by means of the classical convolutional neural network. The experimental results show that the proposed method is feasible during the classification task of short text, and the classification effectiveness is significantly improved. |
| first_indexed | 2024-04-13T07:21:19Z |
| format | Article |
| id | doaj.art-8ee8dc1669624698b836011ee959f4a8 |
| institution | Directory Open Access Journal |
| issn | 1875-6883 |
| language | English |
| last_indexed | 2024-04-13T07:21:19Z |
| publishDate | 2020-12-01 |
| publisher | Springer |
| record_format | Article |
| series | International Journal of Computational Intelligence Systems |
| spelling | doaj.art-8ee8dc1669624698b836011ee959f4a82022-12-22T02:56:37ZengSpringerInternational Journal of Computational Intelligence Systems1875-68832020-12-0114110.2991/ijcis.d.201207.001A Short Text Classification Method Based on Convolutional Neural Network and Semantic ExtensionHaitao WangKeke TianZhengjiang WuLei WangIn order to solve the problem that traditional short text classification methods do not perform well on short text due to the data sparsity and insufficient semantic features, we propose a short text classification method based on convolutional neural network and semantic extension. Firstly, we propose an improved similarity to improve the coverage of the word vector table in the short text preprocessing process. Secondly, we propose a method for semantic expansion of short texts, which adding an attention mechanism to the neural network model to find related words in the short text, and semantic expansion is performed at the sentence level and the related word level of the short text respectively. Finally, the feature extraction of short text is carried out by means of the classical convolutional neural network. The experimental results show that the proposed method is feasible during the classification task of short text, and the classification effectiveness is significantly improved.https://www.atlantis-press.com/article/125948353/viewShort textClassificationCNNSemantic extensionAttention mechanismConceptualization |
| spellingShingle | Haitao Wang Keke Tian Zhengjiang Wu Lei Wang A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension International Journal of Computational Intelligence Systems Short text Classification CNN Semantic extension Attention mechanism Conceptualization |
| title | A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension |
| title_full | A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension |
| title_fullStr | A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension |
| title_full_unstemmed | A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension |
| title_short | A Short Text Classification Method Based on Convolutional Neural Network and Semantic Extension |
| title_sort | short text classification method based on convolutional neural network and semantic extension |
| topic | Short text Classification CNN Semantic extension Attention mechanism Conceptualization |
| url | https://www.atlantis-press.com/article/125948353/view |
| work_keys_str_mv | AT haitaowang ashorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT keketian ashorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT zhengjiangwu ashorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT leiwang ashorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT haitaowang shorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT keketian shorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT zhengjiangwu shorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension AT leiwang shorttextclassificationmethodbasedonconvolutionalneuralnetworkandsemanticextension |