Measuring Text Features in Expository Discourse of Russian Students

The study is aimed at investigating the potential for original automated Russian text analyzer RuLingva to assess linguistic metrics of written recalls of students of Russian as a Foreign language (RFL). Initially developed by the authors to estimate Russian texts readability indices, the public ver...

Full description

Bibliographic Details
Main Authors: Marina Solnyshkina, Elzara Gafiyatova, Ekaterina Martynova, Andrey Danilov
Format: Article
Language:English
Published: Pensoft Publishers 2022-02-01
Series:ARPHA Proceedings
Subjects:
Online Access:https://ap.pensoft.net/article/24407/download/pdf/
_version_ 1827776869007622144
author Marina Solnyshkina
Elzara Gafiyatova
Ekaterina Martynova
Andrey Danilov
author_facet Marina Solnyshkina
Elzara Gafiyatova
Ekaterina Martynova
Andrey Danilov
author_sort Marina Solnyshkina
collection DOAJ
description The study is aimed at investigating the potential for original automated Russian text analyzer RuLingva to assess linguistic metrics of written recalls of students of Russian as a Foreign language (RFL). Initially developed by the authors to estimate Russian texts readability indices, the public version of RuLingva reports on 33 metrics related to text length, readability indices, parts of speech classification, noun case, verb tenses, vocabulary frequency, lexical diversity, abstractness rating, etc. We hypothesize that the abovementioned metrics can be used to discriminate and score written expository discourse of RFL students. The corpus compiled for the study comprises written recalls of 407-word expository texts produced by 71 B2 students of Russian. Each subject’s recall was scaled against the original reading text on the following metrics: text length, average sentence length, average word length, type token ratio, word frequency, abstractness rating, local and global noun overlap, local and global argument overlap. Prior to reading the expository text, we also assessed the subjects’ general knowledge with WISC test and Russian language proficiency with Quick Russian placement Test. T tests of significance indicated a strong positive correlation (>0.05) of both general knowledge and Russian proficiency tests with the abovementioned metrics automatically assessed with RuLingva. The findings enable to narrow the range of text features predicting RFL writing quality and ways of estimating language proficiency. RuLingva as the first Automated Writing Assessment tool for the Russian Language has a potential to be successfully used in formative assessment motivating students to review their writing and contributing to both literal and inferential comprehension.
first_indexed 2024-03-11T14:09:24Z
format Article
id doaj.art-9e5fddf0c00a40319f26b8750dc4a1c6
institution Directory Open Access Journal
issn 2683-0183
language English
last_indexed 2024-03-11T14:09:24Z
publishDate 2022-02-01
publisher Pensoft Publishers
record_format Article
series ARPHA Proceedings
spelling doaj.art-9e5fddf0c00a40319f26b8750dc4a1c62023-11-02T00:40:49ZengPensoft PublishersARPHA Proceedings2683-01832022-02-0151593160910.3897/ap.5.e159324407Measuring Text Features in Expository Discourse of Russian StudentsMarina SolnyshkinaElzara GafiyatovaEkaterina MartynovaAndrey DanilovThe study is aimed at investigating the potential for original automated Russian text analyzer RuLingva to assess linguistic metrics of written recalls of students of Russian as a Foreign language (RFL). Initially developed by the authors to estimate Russian texts readability indices, the public version of RuLingva reports on 33 metrics related to text length, readability indices, parts of speech classification, noun case, verb tenses, vocabulary frequency, lexical diversity, abstractness rating, etc. We hypothesize that the abovementioned metrics can be used to discriminate and score written expository discourse of RFL students. The corpus compiled for the study comprises written recalls of 407-word expository texts produced by 71 B2 students of Russian. Each subject’s recall was scaled against the original reading text on the following metrics: text length, average sentence length, average word length, type token ratio, word frequency, abstractness rating, local and global noun overlap, local and global argument overlap. Prior to reading the expository text, we also assessed the subjects’ general knowledge with WISC test and Russian language proficiency with Quick Russian placement Test. T tests of significance indicated a strong positive correlation (>0.05) of both general knowledge and Russian proficiency tests with the abovementioned metrics automatically assessed with RuLingva. The findings enable to narrow the range of text features predicting RFL writing quality and ways of estimating language proficiency. RuLingva as the first Automated Writing Assessment tool for the Russian Language has a potential to be successfully used in formative assessment motivating students to review their writing and contributing to both literal and inferential comprehension.https://ap.pensoft.net/article/24407/download/pdf/Russian text analyzer RuLingvawritten recallst
spellingShingle Marina Solnyshkina
Elzara Gafiyatova
Ekaterina Martynova
Andrey Danilov
Measuring Text Features in Expository Discourse of Russian Students
ARPHA Proceedings
Russian text analyzer RuLingva
written recalls
t
title Measuring Text Features in Expository Discourse of Russian Students
title_full Measuring Text Features in Expository Discourse of Russian Students
title_fullStr Measuring Text Features in Expository Discourse of Russian Students
title_full_unstemmed Measuring Text Features in Expository Discourse of Russian Students
title_short Measuring Text Features in Expository Discourse of Russian Students
title_sort measuring text features in expository discourse of russian students
topic Russian text analyzer RuLingva
written recalls
t
url https://ap.pensoft.net/article/24407/download/pdf/
work_keys_str_mv AT marinasolnyshkina measuringtextfeaturesinexpositorydiscourseofrussianstudents
AT elzaragafiyatova measuringtextfeaturesinexpositorydiscourseofrussianstudents
AT ekaterinamartynova measuringtextfeaturesinexpositorydiscourseofrussianstudents
AT andreydanilov measuringtextfeaturesinexpositorydiscourseofrussianstudents