An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts
Extracting knowledge from text data is a complex task that is usually performed by first structuring the texts and then applying machine learning algorithms, or by using specific deep architectures capable of dealing directly with the raw text data. The traditional approach to structure texts is cal...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universidad Internacional de La Rioja (UNIR)
2023-09-01
|
| Series: | International Journal of Interactive Multimedia and Artificial Intelligence |
| Subjects: | |
| Online Access: | https://www.ijimai.org/journal/bibcite/reference/3370 |
| _version_ | 1797690559198920704 |
|---|---|
| author | Matheus A. Ferraria Vinicius A. Ferraria Leandro N. de Castro |
| author_facet | Matheus A. Ferraria Vinicius A. Ferraria Leandro N. de Castro |
| author_sort | Matheus A. Ferraria |
| collection | DOAJ |
| description | Extracting knowledge from text data is a complex task that is usually performed by first structuring the texts and then applying machine learning algorithms, or by using specific deep architectures capable of dealing directly with the raw text data. The traditional approach to structure texts is called Bag of Words (BoW) and consists of transforming each word in a document into a dimension (variable) in the structured data. Another approach uses grammatical classes to categorize the words and, thus, limit the dimension of the structured data to the number of grammatical categories. Another form of structuring text data for analysis is by using a distributed representation of words, sentences, or documents with methods like Word2Vec, Doc2Vec, and SBERT. This paper investigates four classes of text structuring methods to prepare documents for being clustered by an artificial immune system called aiNet. The goal is to assess the influence of each structuring method in the quality of the clustering obtained by the system and how methods that belong to the same type of representation differ from each other, for example both LIWC and MRC are considered grammarbased models but each one of them uses completely different dictionaries to generate its representation. By using internal clustering measures, our results showed that vector space models, on average, presented the best results for the datasets chosen, followed closely by the state of the art SBERT model, and MRC had the overall worst performance. We could also observe a consistency in the number of clusters generated by each representation and for each dataset, having SBERT as the model that presented a number of clusters closer to the original number of classes in the data. |
| first_indexed | 2024-03-12T02:01:04Z |
| format | Article |
| id | doaj.art-37047b19fae249f48805f876736bf7b7 |
| institution | Directory Open Access Journal |
| issn | 1989-1660 |
| language | English |
| last_indexed | 2024-03-12T02:01:04Z |
| publishDate | 2023-09-01 |
| publisher | Universidad Internacional de La Rioja (UNIR) |
| record_format | Article |
| series | International Journal of Interactive Multimedia and Artificial Intelligence |
| spelling | doaj.art-37047b19fae249f48805f876736bf7b72023-09-07T14:28:56ZengUniversidad Internacional de La Rioja (UNIR)International Journal of Interactive Multimedia and Artificial Intelligence1989-16602023-09-0183556310.9781/ijimai.2023.08.006ijimai.2023.08.006An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering TextsMatheus A. FerrariaVinicius A. FerrariaLeandro N. de CastroExtracting knowledge from text data is a complex task that is usually performed by first structuring the texts and then applying machine learning algorithms, or by using specific deep architectures capable of dealing directly with the raw text data. The traditional approach to structure texts is called Bag of Words (BoW) and consists of transforming each word in a document into a dimension (variable) in the structured data. Another approach uses grammatical classes to categorize the words and, thus, limit the dimension of the structured data to the number of grammatical categories. Another form of structuring text data for analysis is by using a distributed representation of words, sentences, or documents with methods like Word2Vec, Doc2Vec, and SBERT. This paper investigates four classes of text structuring methods to prepare documents for being clustered by an artificial immune system called aiNet. The goal is to assess the influence of each structuring method in the quality of the clustering obtained by the system and how methods that belong to the same type of representation differ from each other, for example both LIWC and MRC are considered grammarbased models but each one of them uses completely different dictionaries to generate its representation. By using internal clustering measures, our results showed that vector space models, on average, presented the best results for the datasets chosen, followed closely by the state of the art SBERT model, and MRC had the overall worst performance. We could also observe a consistency in the number of clusters generated by each representation and for each dataset, having SBERT as the model that presented a number of clusters closer to the original number of classes in the data.https://www.ijimai.org/journal/bibcite/reference/3370artificial immune systemartificial immune networkclonal selectionnatural computingtext clusteringtext structuring |
| spellingShingle | Matheus A. Ferraria Vinicius A. Ferraria Leandro N. de Castro An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts International Journal of Interactive Multimedia and Artificial Intelligence artificial immune system artificial immune network clonal selection natural computing text clustering text structuring |
| title | An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts |
| title_full | An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts |
| title_fullStr | An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts |
| title_full_unstemmed | An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts |
| title_short | An Investigation Into Different Text Representations to Train an Artificial Immune Network for Clustering Texts |
| title_sort | investigation into different text representations to train an artificial immune network for clustering texts |
| topic | artificial immune system artificial immune network clonal selection natural computing text clustering text structuring |
| url | https://www.ijimai.org/journal/bibcite/reference/3370 |
| work_keys_str_mv | AT matheusaferraria aninvestigationintodifferenttextrepresentationstotrainanartificialimmunenetworkforclusteringtexts AT viniciusaferraria aninvestigationintodifferenttextrepresentationstotrainanartificialimmunenetworkforclusteringtexts AT leandrondecastro aninvestigationintodifferenttextrepresentationstotrainanartificialimmunenetworkforclusteringtexts AT matheusaferraria investigationintodifferenttextrepresentationstotrainanartificialimmunenetworkforclusteringtexts AT viniciusaferraria investigationintodifferenttextrepresentationstotrainanartificialimmunenetworkforclusteringtexts AT leandrondecastro investigationintodifferenttextrepresentationstotrainanartificialimmunenetworkforclusteringtexts |