Application of LDA and word2vec to detect English off-topic composition.
This paper presents an off-topic detection algorithm combining LDA and word2vec aiming at the problem of the lack of accurate and efficient off-topic detection algorithms in the English composition-assisted review system. The algorithm uses the LDA model to model the document and train the document...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0264552 |
| _version_ | 1797867509630631936 |
|---|---|
| author | Yilan Qi Jun He |
| author_facet | Yilan Qi Jun He |
| author_sort | Yilan Qi |
| collection | DOAJ |
| description | This paper presents an off-topic detection algorithm combining LDA and word2vec aiming at the problem of the lack of accurate and efficient off-topic detection algorithms in the English composition-assisted review system. The algorithm uses the LDA model to model the document and train the document through the word2vec, and uses the semantic relationship between the document's topics and words to calculate the probability weighted sum for each topic and its feature words in the document, and finally selects the off-topic composition by setting a reasonable threshold. Different F values are obtained by changing the number of topics in the document, and the best number of topics is determined. Experimental results show that the proposed method is more effective than vector space model, can detect more off-topic compositions, and the accuracy is higher, the F value is more than 88%, which realizes the intelligent processing of off-topic detection of composition, and can be effectively applied in English composition teaching. |
| first_indexed | 2024-04-09T23:42:26Z |
| format | Article |
| id | doaj.art-2431cd78574841158df8f098d6903fb4 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-09T23:42:26Z |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-2431cd78574841158df8f098d6903fb42023-03-18T05:32:19ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-01172e026455210.1371/journal.pone.0264552Application of LDA and word2vec to detect English off-topic composition.Yilan QiJun HeThis paper presents an off-topic detection algorithm combining LDA and word2vec aiming at the problem of the lack of accurate and efficient off-topic detection algorithms in the English composition-assisted review system. The algorithm uses the LDA model to model the document and train the document through the word2vec, and uses the semantic relationship between the document's topics and words to calculate the probability weighted sum for each topic and its feature words in the document, and finally selects the off-topic composition by setting a reasonable threshold. Different F values are obtained by changing the number of topics in the document, and the best number of topics is determined. Experimental results show that the proposed method is more effective than vector space model, can detect more off-topic compositions, and the accuracy is higher, the F value is more than 88%, which realizes the intelligent processing of off-topic detection of composition, and can be effectively applied in English composition teaching.https://doi.org/10.1371/journal.pone.0264552 |
| spellingShingle | Yilan Qi Jun He Application of LDA and word2vec to detect English off-topic composition. PLoS ONE |
| title | Application of LDA and word2vec to detect English off-topic composition. |
| title_full | Application of LDA and word2vec to detect English off-topic composition. |
| title_fullStr | Application of LDA and word2vec to detect English off-topic composition. |
| title_full_unstemmed | Application of LDA and word2vec to detect English off-topic composition. |
| title_short | Application of LDA and word2vec to detect English off-topic composition. |
| title_sort | application of lda and word2vec to detect english off topic composition |
| url | https://doi.org/10.1371/journal.pone.0264552 |
| work_keys_str_mv | AT yilanqi applicationofldaandword2vectodetectenglishofftopiccomposition AT junhe applicationofldaandword2vectodetectenglishofftopiccomposition |