Incoherent Sentence Detection in Scientific Articles in Russian and English
Text coherence is an important factor that often gets overlooked by novice writers. Incoherence in academic writing directly affects both the reading experience and the comprehensibility of the articles. This paper introduces and describes a method for detecting incoherence in academic writing. The...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
FRUCT
2021-05-01
|
| Series: | Proceedings of the XXth Conference of Open Innovations Association FRUCT |
| Subjects: | |
| Online Access: | https://www.fruct.org/publications/fruct29/files/Ngu.pdf |
| _version_ | 1818728584318025728 |
|---|---|
| author | Mark Zaslavskiy Quang Huy Nguyen |
| author_facet | Mark Zaslavskiy Quang Huy Nguyen |
| author_sort | Mark Zaslavskiy |
| collection | DOAJ |
| description | Text coherence is an important factor that often gets overlooked by novice writers. Incoherence in academic writing directly affects both the reading experience and the comprehensibility of the articles. This paper introduces and describes a method for detecting incoherence in academic writing. The method utilized a fine-tuned BERT model in conjunction with graph clustering algorithm. We benchmarked the method against baseline models on Discordant Sentence Detection using Timetravel dataset, and the results showed that the proposed method outperformed baseline models in terms of F1-score. Afterward, the method was tested on a corpora of Russian and English scientific articles in order to assess its proficiency in Narrative Incoherence Detection when applied on the papers main research subject: academic writing. The papers proposed method achieved a decent F1 in Discordant Sentence Detection. For future work, our biggest goal is to further refine the method and be able to effectively deploy it on existing systems used for reviewing academic corpora. |
| first_indexed | 2024-12-17T22:32:19Z |
| format | Article |
| id | doaj.art-0a1ffeb235ff40c2833b7c27d20efe33 |
| institution | Directory Open Access Journal |
| issn | 2305-7254 2343-0737 |
| language | English |
| last_indexed | 2024-12-17T22:32:19Z |
| publishDate | 2021-05-01 |
| publisher | FRUCT |
| record_format | Article |
| series | Proceedings of the XXth Conference of Open Innovations Association FRUCT |
| spelling | doaj.art-0a1ffeb235ff40c2833b7c27d20efe332022-12-21T21:30:09ZengFRUCTProceedings of the XXth Conference of Open Innovations Association FRUCT2305-72542343-07372021-05-0129126727310.23919/FRUCT52173.2021.9435478Incoherent Sentence Detection in Scientific Articles in Russian and EnglishMark Zaslavskiy0Quang Huy Nguyen1St. Petersburg Electrotechnical University / JetBrains Research, RussiaSaint Petersburg Electrotechnical University (LETI), RussiaText coherence is an important factor that often gets overlooked by novice writers. Incoherence in academic writing directly affects both the reading experience and the comprehensibility of the articles. This paper introduces and describes a method for detecting incoherence in academic writing. The method utilized a fine-tuned BERT model in conjunction with graph clustering algorithm. We benchmarked the method against baseline models on Discordant Sentence Detection using Timetravel dataset, and the results showed that the proposed method outperformed baseline models in terms of F1-score. Afterward, the method was tested on a corpora of Russian and English scientific articles in order to assess its proficiency in Narrative Incoherence Detection when applied on the papers main research subject: academic writing. The papers proposed method achieved a decent F1 in Discordant Sentence Detection. For future work, our biggest goal is to further refine the method and be able to effectively deploy it on existing systems used for reviewing academic corpora.https://www.fruct.org/publications/fruct29/files/Ngu.pdfincoherent sentence detectiontext coherencebertdiscordant sentence detectionnarrative incoherence detection |
| spellingShingle | Mark Zaslavskiy Quang Huy Nguyen Incoherent Sentence Detection in Scientific Articles in Russian and English Proceedings of the XXth Conference of Open Innovations Association FRUCT incoherent sentence detection text coherence bert discordant sentence detection narrative incoherence detection |
| title | Incoherent Sentence Detection in Scientific Articles in Russian and English |
| title_full | Incoherent Sentence Detection in Scientific Articles in Russian and English |
| title_fullStr | Incoherent Sentence Detection in Scientific Articles in Russian and English |
| title_full_unstemmed | Incoherent Sentence Detection in Scientific Articles in Russian and English |
| title_short | Incoherent Sentence Detection in Scientific Articles in Russian and English |
| title_sort | incoherent sentence detection in scientific articles in russian and english |
| topic | incoherent sentence detection text coherence bert discordant sentence detection narrative incoherence detection |
| url | https://www.fruct.org/publications/fruct29/files/Ngu.pdf |
| work_keys_str_mv | AT markzaslavskiy incoherentsentencedetectioninscientificarticlesinrussianandenglish AT quanghuynguyen incoherentsentencedetectioninscientificarticlesinrussianandenglish |