Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset
Sentiment analysis is a major area of natural language processing (NLP) research, and its sub-area of sarcasm detection has received growing interest in the past decade. Many approaches have been proposed, from basic machine learning to multi-modal deep learning solutions, and progress has been made...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-01-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/12/3/666 |
| _version_ | 1797624781886980096 |
|---|---|
| author | Alexandru-Costin Băroiu Ștefan Trăușan-Matu |
| author_facet | Alexandru-Costin Băroiu Ștefan Trăușan-Matu |
| author_sort | Alexandru-Costin Băroiu |
| collection | DOAJ |
| description | Sentiment analysis is a major area of natural language processing (NLP) research, and its sub-area of sarcasm detection has received growing interest in the past decade. Many approaches have been proposed, from basic machine learning to multi-modal deep learning solutions, and progress has been made. Context has proven to be instrumental for sarcasm and many techniques that use context to identify sarcasm have emerged. However, no NLP research has focused on sarcasm-context detection as the main topic. Therefore, this paper proposes an approach for the automatic detection of sarcasm context, aiming to develop models that can correctly identify the contexts in which sarcasm may occur or is appropriate. Using an established dataset, MUStARD, multiple models are trained and benchmarked to find the best performer for sarcasm-context detection. This performer is proven to be an attention-based long short-term memory architecture that achieves an F1 score of 60.1. Furthermore, we tested the performance of this model on the SARC dataset and compared it with other results reported in the literature to better assess the effectiveness of this approach. Future directions of study are opened, with the prospect of developing a conversational agent that could identify and even respond to sarcasm. |
| first_indexed | 2024-03-11T09:47:33Z |
| format | Article |
| id | doaj.art-dcb651aab5594545a2fa602968445e43 |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-11T09:47:33Z |
| publishDate | 2023-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-dcb651aab5594545a2fa602968445e432023-11-16T16:29:44ZengMDPI AGElectronics2079-92922023-01-0112366610.3390/electronics12030666Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD DatasetAlexandru-Costin Băroiu0Ștefan Trăușan-Matu1Faculty of Automatic Control and Computer Science, Politehnica University of Bucharest, 060042 Bucharest, RomaniaFaculty of Automatic Control and Computer Science, Politehnica University of Bucharest, 060042 Bucharest, RomaniaSentiment analysis is a major area of natural language processing (NLP) research, and its sub-area of sarcasm detection has received growing interest in the past decade. Many approaches have been proposed, from basic machine learning to multi-modal deep learning solutions, and progress has been made. Context has proven to be instrumental for sarcasm and many techniques that use context to identify sarcasm have emerged. However, no NLP research has focused on sarcasm-context detection as the main topic. Therefore, this paper proposes an approach for the automatic detection of sarcasm context, aiming to develop models that can correctly identify the contexts in which sarcasm may occur or is appropriate. Using an established dataset, MUStARD, multiple models are trained and benchmarked to find the best performer for sarcasm-context detection. This performer is proven to be an attention-based long short-term memory architecture that achieves an F1 score of 60.1. Furthermore, we tested the performance of this model on the SARC dataset and compared it with other results reported in the literature to better assess the effectiveness of this approach. Future directions of study are opened, with the prospect of developing a conversational agent that could identify and even respond to sarcasm.https://www.mdpi.com/2079-9292/12/3/666machine learningnatural language processingsentiment analysissarcasm |
| spellingShingle | Alexandru-Costin Băroiu Ștefan Trăușan-Matu Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset Electronics machine learning natural language processing sentiment analysis sarcasm |
| title | Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset |
| title_full | Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset |
| title_fullStr | Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset |
| title_full_unstemmed | Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset |
| title_short | Comparison of Deep Learning Models for Automatic Detection of Sarcasm Context on the MUStARD Dataset |
| title_sort | comparison of deep learning models for automatic detection of sarcasm context on the mustard dataset |
| topic | machine learning natural language processing sentiment analysis sarcasm |
| url | https://www.mdpi.com/2079-9292/12/3/666 |
| work_keys_str_mv | AT alexandrucostinbaroiu comparisonofdeeplearningmodelsforautomaticdetectionofsarcasmcontextonthemustarddataset AT stefantrausanmatu comparisonofdeeplearningmodelsforautomaticdetectionofsarcasmcontextonthemustarddataset |