Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays
This paper presents a study based on the linguistic profiling methodology to explore the relationship between the linguistic structure of a text and how it is perceived in terms of writing quality by humans. The approach is tested on a selection of Italian L1 learners essays, which were taken from a...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Accademia University Press
2023-08-01
|
| Series: | IJCoL |
| Online Access: | http://journals.openedition.org/ijcol/1104 |
| _version_ | 1797667688754970624 |
|---|---|
| author | Aldo Cerulli Dominique Brunato Felice Dell’Orletta |
| author_facet | Aldo Cerulli Dominique Brunato Felice Dell’Orletta |
| author_sort | Aldo Cerulli |
| collection | DOAJ |
| description | This paper presents a study based on the linguistic profiling methodology to explore the relationship between the linguistic structure of a text and how it is perceived in terms of writing quality by humans. The approach is tested on a selection of Italian L1 learners essays, which were taken from a larger longitudinal corpus of essays written by Italian L1 students enrolled in the first and second year of lower secondary school. Human ratings of writing quality by Italian native speakers were collected through a crowdsourcing task, in which annotators were asked to read pairs of essays and rated which one they believed to be better written. By analyzing these ratings, the study identifies a variety of linguistic phenomena spanning across distinct levels of linguistic description that distinguish the essays considered as ‘winners’ and evaluates the impact of students’ errors on the human perception of writing quality. |
| first_indexed | 2024-03-11T20:17:58Z |
| format | Article |
| id | doaj.art-22ab10cd8a3643ba8d922b0ace4e1d1f |
| institution | Directory Open Access Journal |
| issn | 2499-4553 |
| language | English |
| last_indexed | 2024-03-11T20:17:58Z |
| publishDate | 2023-08-01 |
| publisher | Accademia University Press |
| record_format | Article |
| series | IJCoL |
| spelling | doaj.art-22ab10cd8a3643ba8d922b0ace4e1d1f2023-10-03T10:35:15ZengAccademia University PressIJCoL2499-45532023-08-019110.4000/ijcol.1104Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner EssaysAldo CerulliDominique BrunatoFelice Dell’OrlettaThis paper presents a study based on the linguistic profiling methodology to explore the relationship between the linguistic structure of a text and how it is perceived in terms of writing quality by humans. The approach is tested on a selection of Italian L1 learners essays, which were taken from a larger longitudinal corpus of essays written by Italian L1 students enrolled in the first and second year of lower secondary school. Human ratings of writing quality by Italian native speakers were collected through a crowdsourcing task, in which annotators were asked to read pairs of essays and rated which one they believed to be better written. By analyzing these ratings, the study identifies a variety of linguistic phenomena spanning across distinct levels of linguistic description that distinguish the essays considered as ‘winners’ and evaluates the impact of students’ errors on the human perception of writing quality.http://journals.openedition.org/ijcol/1104 |
| spellingShingle | Aldo Cerulli Dominique Brunato Felice Dell’Orletta Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays IJCoL |
| title | Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays |
| title_full | Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays |
| title_fullStr | Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays |
| title_full_unstemmed | Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays |
| title_short | Linguistic Profile of a Text and Human Ratings of Writing Quality: a Case Study on Italian L1 Learner Essays |
| title_sort | linguistic profile of a text and human ratings of writing quality a case study on italian l1 learner essays |
| url | http://journals.openedition.org/ijcol/1104 |
| work_keys_str_mv | AT aldocerulli linguisticprofileofatextandhumanratingsofwritingqualityacasestudyonitalianl1learneressays AT dominiquebrunato linguisticprofileofatextandhumanratingsofwritingqualityacasestudyonitalianl1learneressays AT felicedellorletta linguisticprofileofatextandhumanratingsofwritingqualityacasestudyonitalianl1learneressays |