Assessing second language oral proficiency development with holistic and analytic scales

The present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation...

Full description

Bibliographic Details
Main Authors: Rosane Silveira, Thaisy da Silva Martins
Format: Article
Language:English
Published: Universidade Federal de Santa Catarina 2020-10-01
Series:Ilha do Desterro
Subjects:
Online Access:https://periodicos.ufsc.br/index.php/desterro/article/view/72059
_version_ 1811267154370101248
author Rosane Silveira
Thaisy da Silva Martins
author_facet Rosane Silveira
Thaisy da Silva Martins
author_sort Rosane Silveira
collection DOAJ
description The present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development.
first_indexed 2024-04-12T20:57:17Z
format Article
id doaj.art-c6ac27a220f74828b6046894a4411da6
institution Directory Open Access Journal
issn 0101-4846
2175-8026
language English
last_indexed 2024-04-12T20:57:17Z
publishDate 2020-10-01
publisher Universidade Federal de Santa Catarina
record_format Article
series Ilha do Desterro
spelling doaj.art-c6ac27a220f74828b6046894a4411da62022-12-22T03:16:58ZengUniversidade Federal de Santa CatarinaIlha do Desterro0101-48462175-80262020-10-0173310.5007/2175-8026.2020v73n3p227Assessing second language oral proficiency development with holistic and analytic scalesRosane Silveira0Thaisy da Silva Martins1Universidade Federal de Santa Catarina/CNPqUFSCThe present study discusses how a group of experienced raters use different types of scales to assess the development of oral proficiency in English as a second language (L2). Raters assigned rates to speech samples first using a holistic scale (CEFR, 2018) and then assigning rates for pronunciation, vocabulary, grammar and fluency performance using individual scales. The speech samples were recorded by five Brazilians. There were two data collection sessions, with the second one occurring 7-8 months after the first one. The results indicate high levels of agreement among raters for all scales. Furthermore, the raters detected changes in speakers’ performance in four out of five scales: L2 oral proficiency, vocabulary, grammar, and fluency, and these differences in rates across time were significant for oral proficiency, vocabulary, and fluency. Thus, the different types of scale allow detecting L2 oral proficiency development.https://periodicos.ufsc.br/index.php/desterro/article/view/72059L2 AssessmentOral Proficiency DevelopmentHolistic and Analytic Scales
spellingShingle Rosane Silveira
Thaisy da Silva Martins
Assessing second language oral proficiency development with holistic and analytic scales
Ilha do Desterro
L2 Assessment
Oral Proficiency Development
Holistic and Analytic Scales
title Assessing second language oral proficiency development with holistic and analytic scales
title_full Assessing second language oral proficiency development with holistic and analytic scales
title_fullStr Assessing second language oral proficiency development with holistic and analytic scales
title_full_unstemmed Assessing second language oral proficiency development with holistic and analytic scales
title_short Assessing second language oral proficiency development with holistic and analytic scales
title_sort assessing second language oral proficiency development with holistic and analytic scales
topic L2 Assessment
Oral Proficiency Development
Holistic and Analytic Scales
url https://periodicos.ufsc.br/index.php/desterro/article/view/72059
work_keys_str_mv AT rosanesilveira assessingsecondlanguageoralproficiencydevelopmentwithholisticandanalyticscales
AT thaisydasilvamartins assessingsecondlanguageoralproficiencydevelopmentwithholisticandanalyticscales