Multi-Label Classification of Microblogging Texts Using Convolution Neural Network
Microblogging sites contain a huge amount of textual data and their classification is an imperative task in many applications, such as information filtering, user profiling, topical analysis, and content tagging. Traditional machine learning approaches mainly use a bag of words or n-gram techniques...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8723320/ |
_version_ | 1819276220223717376 |
---|---|
author | Md. Aslam Parwez Muhammad Abulaish Jahiruddin |
author_facet | Md. Aslam Parwez Muhammad Abulaish Jahiruddin |
author_sort | Md. Aslam Parwez |
collection | DOAJ |
description | Microblogging sites contain a huge amount of textual data and their classification is an imperative task in many applications, such as information filtering, user profiling, topical analysis, and content tagging. Traditional machine learning approaches mainly use a bag of words or n-gram techniques to generate feature vectors as text representation to train classifiers and perform considerably well for many text information processing tasks. Since short texts, such as tweets, contain a very limited number of words, the traditional machine learning approaches suffer from data sparsity and curse of dimensionality problems due to feature representation using a bag of words or n-grams techniques. Nowadays, the use of feature vectors, such as word embeddings, as an input to neural networks for text classification and clustering has shown a remarkable performance gain. In this paper, we present the different neural network models for multi-label classification of microblogging data. The proposed models are based on convolutional neural network (CNN) architectures, which utilize pre-trained word embeddings from generic and domain-specific textual data sources. The word embeddings are used individually and in various combinations through different channels of CNN to predict class labels. We also present a comparative analysis of the proposed CNN models with traditional machine learning models and one of the existing CNN architectures. The proposed models are evaluated over a real Twitter dataset, and the experimental results establish their efficacy to classify microblogging texts with improved accuracy in comparison with the traditional machine learning approaches and the existing CNN models. |
first_indexed | 2024-12-23T23:36:45Z |
format | Article |
id | doaj.art-cbd8ad28c2cf4f98ad8ee7691e36ab8d |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-23T23:36:45Z |
publishDate | 2019-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-cbd8ad28c2cf4f98ad8ee7691e36ab8d2022-12-21T17:25:51ZengIEEEIEEE Access2169-35362019-01-017686786869110.1109/ACCESS.2019.29194948723320Multi-Label Classification of Microblogging Texts Using Convolution Neural NetworkMd. Aslam Parwez0https://orcid.org/0000-0003-0087-7171Muhammad Abulaish1https://orcid.org/0000-0003-3387-4743 Jahiruddin2Department of Computer Science, Jamia Millia Islamia (A Central University), New Delhi, IndiaDepartment of Computer Science, South Asian University, New Delhi, IndiaDepartment of Computer Science, Jamia Millia Islamia (A Central University), New Delhi, IndiaMicroblogging sites contain a huge amount of textual data and their classification is an imperative task in many applications, such as information filtering, user profiling, topical analysis, and content tagging. Traditional machine learning approaches mainly use a bag of words or n-gram techniques to generate feature vectors as text representation to train classifiers and perform considerably well for many text information processing tasks. Since short texts, such as tweets, contain a very limited number of words, the traditional machine learning approaches suffer from data sparsity and curse of dimensionality problems due to feature representation using a bag of words or n-grams techniques. Nowadays, the use of feature vectors, such as word embeddings, as an input to neural networks for text classification and clustering has shown a remarkable performance gain. In this paper, we present the different neural network models for multi-label classification of microblogging data. The proposed models are based on convolutional neural network (CNN) architectures, which utilize pre-trained word embeddings from generic and domain-specific textual data sources. The word embeddings are used individually and in various combinations through different channels of CNN to predict class labels. We also present a comparative analysis of the proposed CNN models with traditional machine learning models and one of the existing CNN architectures. The proposed models are evaluated over a real Twitter dataset, and the experimental results establish their efficacy to classify microblogging texts with improved accuracy in comparison with the traditional machine learning approaches and the existing CNN models.https://ieeexplore.ieee.org/document/8723320/Social network analysismachine learningdeep learningmulti-label classificationword embeddingconvolution neural network |
spellingShingle | Md. Aslam Parwez Muhammad Abulaish Jahiruddin Multi-Label Classification of Microblogging Texts Using Convolution Neural Network IEEE Access Social network analysis machine learning deep learning multi-label classification word embedding convolution neural network |
title | Multi-Label Classification of Microblogging Texts Using Convolution Neural Network |
title_full | Multi-Label Classification of Microblogging Texts Using Convolution Neural Network |
title_fullStr | Multi-Label Classification of Microblogging Texts Using Convolution Neural Network |
title_full_unstemmed | Multi-Label Classification of Microblogging Texts Using Convolution Neural Network |
title_short | Multi-Label Classification of Microblogging Texts Using Convolution Neural Network |
title_sort | multi label classification of microblogging texts using convolution neural network |
topic | Social network analysis machine learning deep learning multi-label classification word embedding convolution neural network |
url | https://ieeexplore.ieee.org/document/8723320/ |
work_keys_str_mv | AT mdaslamparwez multilabelclassificationofmicrobloggingtextsusingconvolutionneuralnetwork AT muhammadabulaish multilabelclassificationofmicrobloggingtextsusingconvolutionneuralnetwork AT jahiruddin multilabelclassificationofmicrobloggingtextsusingconvolutionneuralnetwork |