On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task
The Rasa open-source toolkit provides a valuable Natural Language Understanding (NLU) infrastructure to assist the development of conversational agents. In this paper, we show that this infrastructure can seamlessly and effectively be used for other different NLU-related text classification tasks, s...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9913993/ |
| _version_ | 1811241650323718144 |
|---|---|
| author | Miguel Arevalillo-Herraez Pablo Arnau-Gonzalez Naeem Ramzan |
| author_facet | Miguel Arevalillo-Herraez Pablo Arnau-Gonzalez Naeem Ramzan |
| author_sort | Miguel Arevalillo-Herraez |
| collection | DOAJ |
| description | The Rasa open-source toolkit provides a valuable Natural Language Understanding (NLU) infrastructure to assist the development of conversational agents. In this paper, we show that this infrastructure can seamlessly and effectively be used for other different NLU-related text classification tasks, such as sentiment analysis. The approach is evaluated on three widely used datasets containing movie reviews, namely IMDb, Movie Review (MR) and the Stanford Sentiment Treebank (SST2). The results are consistent across the three databases, and show that even simple configurations of the NLU pipeline lead to accuracy rates that are comparable to those obtained with other state-of-the-art architectures. The best results were obtained when the Dual Intent and Entity Transformer (DIET) architecture was fed with pre-trained word embeddings, surpassing other recent proposals in the sentiment analysis field. In particular, accuracy rates of 0.907, 0.816 and 0.858 were obtained for the IMDb, MR and SST2 datasets, respectively. |
| first_indexed | 2024-04-12T13:39:10Z |
| format | Article |
| id | doaj.art-8cff50fc84a64605b07a595943e63911 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-12T13:39:10Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-8cff50fc84a64605b07a595943e639112022-12-22T03:30:54ZengIEEEIEEE Access2169-35362022-01-011010747710748710.1109/ACCESS.2022.32130619913993On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis TaskMiguel Arevalillo-Herraez0https://orcid.org/0000-0002-0350-2079Pablo Arnau-Gonzalez1Naeem Ramzan2https://orcid.org/0000-0002-5088-1462Departament d’Informática, Universitat de València, Valencia, Burjassot, SpainDepartament d’Informática, Universitat de València, Valencia, Burjassot, SpainSchool of Computing, Engineering and Physical Sciences, University of the West of Scotland, Paisley, U.KThe Rasa open-source toolkit provides a valuable Natural Language Understanding (NLU) infrastructure to assist the development of conversational agents. In this paper, we show that this infrastructure can seamlessly and effectively be used for other different NLU-related text classification tasks, such as sentiment analysis. The approach is evaluated on three widely used datasets containing movie reviews, namely IMDb, Movie Review (MR) and the Stanford Sentiment Treebank (SST2). The results are consistent across the three databases, and show that even simple configurations of the NLU pipeline lead to accuracy rates that are comparable to those obtained with other state-of-the-art architectures. The best results were obtained when the Dual Intent and Entity Transformer (DIET) architecture was fed with pre-trained word embeddings, surpassing other recent proposals in the sentiment analysis field. In particular, accuracy rates of 0.907, 0.816 and 0.858 were obtained for the IMDb, MR and SST2 datasets, respectively.https://ieeexplore.ieee.org/document/9913993/Sentiment analysisRasaDIETsentence classificationNLU |
| spellingShingle | Miguel Arevalillo-Herraez Pablo Arnau-Gonzalez Naeem Ramzan On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task IEEE Access Sentiment analysis Rasa DIET sentence classification NLU |
| title | On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task |
| title_full | On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task |
| title_fullStr | On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task |
| title_full_unstemmed | On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task |
| title_short | On Adapting the DIET Architecture and the Rasa Conversational Toolkit for the Sentiment Analysis Task |
| title_sort | on adapting the diet architecture and the rasa conversational toolkit for the sentiment analysis task |
| topic | Sentiment analysis Rasa DIET sentence classification NLU |
| url | https://ieeexplore.ieee.org/document/9913993/ |
| work_keys_str_mv | AT miguelarevalilloherraez onadaptingthedietarchitectureandtherasaconversationaltoolkitforthesentimentanalysistask AT pabloarnaugonzalez onadaptingthedietarchitectureandtherasaconversationaltoolkitforthesentimentanalysistask AT naeemramzan onadaptingthedietarchitectureandtherasaconversationaltoolkitforthesentimentanalysistask |