Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text
Latent dirichlet allocation (LDA) is a representative topic model to extract keywords related to latent topics embedded in a document set. Despite its effectiveness in finding underlying topics in documents, the traditional algorithm of LDA does not have a process to reflect sentimental meanings in...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-10-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/9/21/4565 |
| _version_ | 1818199202190065664 |
|---|---|
| author | Youngjae Im Jaehyun Park Minyeong Kim Kijung Park |
| author_facet | Youngjae Im Jaehyun Park Minyeong Kim Kijung Park |
| author_sort | Youngjae Im |
| collection | DOAJ |
| description | Latent dirichlet allocation (LDA) is a representative topic model to extract keywords related to latent topics embedded in a document set. Despite its effectiveness in finding underlying topics in documents, the traditional algorithm of LDA does not have a process to reflect sentimental meanings in text for topic extraction. Focusing on this issue, this study aims to investigate the usability of both LDA and sentiment analysis (SA) algorithms based on the affective level of text. This study defines the affective level of a given set of paragraphs and attempts to analyze the perceived trust of the methodologies in regards to usability. In our experiments, the text of the college scholastic ability test was selected as the set of evaluation paragraphs, and the affective level of the paragraphs was manipulated into three levels (low, medium, and high) as an independent variable. The LDA algorithm was used to extract the keywords of the paragraph, while SA was used to identify the positive or negative mood of the extracted subject word. In addition, the perceived trust score of the algorithm was evaluated by the subjects, and this study verifies whether there is a difference in the score according to the affective levels of the paragraphs. The results show that paragraphs with low affect lead to the high perceived trust of LDA from the participants. However, the perceived trust of SA does not show a statistically significant difference between the affect levels. The findings from this study indicate that LDA is more effective to find topics in text that mainly contains objective information. |
| first_indexed | 2024-12-12T02:18:01Z |
| format | Article |
| id | doaj.art-74e83e8bad654617a9cdb611ce5ea548 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-12-12T02:18:01Z |
| publishDate | 2019-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-74e83e8bad654617a9cdb611ce5ea5482022-12-22T00:41:45ZengMDPI AGApplied Sciences2076-34172019-10-01921456510.3390/app9214565app9214565Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational TextYoungjae Im0Jaehyun Park1Minyeong Kim2Kijung Park3Division of Design Engineering, Dong-eui University, Busan 47340, KoreaDepartment of Industrial and Management Engineering, Incheon National University, Incheon 22012, KoreaDepartment of Industrial and Management Engineering, Incheon National University, Incheon 22012, KoreaDepartment of Industrial and Management Engineering, Incheon National University, Incheon 22012, KoreaLatent dirichlet allocation (LDA) is a representative topic model to extract keywords related to latent topics embedded in a document set. Despite its effectiveness in finding underlying topics in documents, the traditional algorithm of LDA does not have a process to reflect sentimental meanings in text for topic extraction. Focusing on this issue, this study aims to investigate the usability of both LDA and sentiment analysis (SA) algorithms based on the affective level of text. This study defines the affective level of a given set of paragraphs and attempts to analyze the perceived trust of the methodologies in regards to usability. In our experiments, the text of the college scholastic ability test was selected as the set of evaluation paragraphs, and the affective level of the paragraphs was manipulated into three levels (low, medium, and high) as an independent variable. The LDA algorithm was used to extract the keywords of the paragraph, while SA was used to identify the positive or negative mood of the extracted subject word. In addition, the perceived trust score of the algorithm was evaluated by the subjects, and this study verifies whether there is a difference in the score according to the affective levels of the paragraphs. The results show that paragraphs with low affect lead to the high perceived trust of LDA from the participants. However, the perceived trust of SA does not show a statistically significant difference between the affect levels. The findings from this study indicate that LDA is more effective to find topics in text that mainly contains objective information.https://www.mdpi.com/2076-3417/9/21/4565latent dirichlet allocation (lda)sentiment analysis (sa)topic modelingaffective level |
| spellingShingle | Youngjae Im Jaehyun Park Minyeong Kim Kijung Park Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text Applied Sciences latent dirichlet allocation (lda) sentiment analysis (sa) topic modeling affective level |
| title | Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text |
| title_full | Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text |
| title_fullStr | Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text |
| title_full_unstemmed | Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text |
| title_short | Comparative Study on Perceived Trust of Topic Modeling Based on Affective Level of Educational Text |
| title_sort | comparative study on perceived trust of topic modeling based on affective level of educational text |
| topic | latent dirichlet allocation (lda) sentiment analysis (sa) topic modeling affective level |
| url | https://www.mdpi.com/2076-3417/9/21/4565 |
| work_keys_str_mv | AT youngjaeim comparativestudyonperceivedtrustoftopicmodelingbasedonaffectivelevelofeducationaltext AT jaehyunpark comparativestudyonperceivedtrustoftopicmodelingbasedonaffectivelevelofeducationaltext AT minyeongkim comparativestudyonperceivedtrustoftopicmodelingbasedonaffectivelevelofeducationaltext AT kijungpark comparativestudyonperceivedtrustoftopicmodelingbasedonaffectivelevelofeducationaltext |