Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments
The Common European Framework of Reference (CEFR) was empirically derived from experienced teachers’ intuitive judgements and although it may seem adequate, assessment theorists argue on the absence of performance data-driven approach in structuring its rating scale. Therefore, the objective of this...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Published: |
American Scientific Publishers
2017
|
| Subjects: |
| _version_ | 1796862306856992768 |
|---|---|
| author | Idris, M. Abdul Raof, A. H. |
| author_facet | Idris, M. Abdul Raof, A. H. |
| author_sort | Idris, M. |
| collection | ePrints |
| description | The Common European Framework of Reference (CEFR) was empirically derived from experienced teachers’ intuitive judgements and although it may seem adequate, assessment theorists argue on the absence of performance data-driven approach in structuring its rating scale. Therefore, the objective of this study was to gauge rating scale functioning of five CEFR oral assessment criteria (overall impression, range, accuracy, fluency and coherence), based on ratings awarded by intermediate ESL learners during self- and peer assessments of their speaking skills. Before learners embarked on awarding ratings to their own performance as well as their peers,’ they were trained to understand and apply the criteria and the corresponding ratings based on the benchmarked videos provided on the CEFR official website. Findings on rater measurement report suggest that learners were within productive measurement range based on their infit and outfit mean-squares and the reliability of their ratings was reported at 0.91. However, only four out of six rating categories were utilized in all five CEFR oral assessment criteria and this was illustrated through category probability curve for each criterion. The implications of the findings are discussed in view of learner performance and classroom instruction. |
| first_indexed | 2024-03-05T20:09:38Z |
| format | Article |
| id | utm.eprints-75249 |
| institution | Universiti Teknologi Malaysia - ePrints |
| last_indexed | 2024-03-05T20:09:38Z |
| publishDate | 2017 |
| publisher | American Scientific Publishers |
| record_format | dspace |
| spelling | utm.eprints-752492018-03-27T06:05:43Z http://eprints.utm.my/75249/ Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments Idris, M. Abdul Raof, A. H. L Education (General) The Common European Framework of Reference (CEFR) was empirically derived from experienced teachers’ intuitive judgements and although it may seem adequate, assessment theorists argue on the absence of performance data-driven approach in structuring its rating scale. Therefore, the objective of this study was to gauge rating scale functioning of five CEFR oral assessment criteria (overall impression, range, accuracy, fluency and coherence), based on ratings awarded by intermediate ESL learners during self- and peer assessments of their speaking skills. Before learners embarked on awarding ratings to their own performance as well as their peers,’ they were trained to understand and apply the criteria and the corresponding ratings based on the benchmarked videos provided on the CEFR official website. Findings on rater measurement report suggest that learners were within productive measurement range based on their infit and outfit mean-squares and the reliability of their ratings was reported at 0.91. However, only four out of six rating categories were utilized in all five CEFR oral assessment criteria and this was illustrated through category probability curve for each criterion. The implications of the findings are discussed in view of learner performance and classroom instruction. American Scientific Publishers 2017 Article PeerReviewed Idris, M. and Abdul Raof, A. H. (2017) Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments. Advanced Science Letters, 23 (4). pp. 2644-2647. ISSN 1936-6612 https://www.scopus.com/inward/record.uri?eid=2-s2.0-85021173930&doi=10.1166%2fasl.2017.7710&partnerID=40&md5=e22606794a9ab3b6b384753a4792e671 DOI:10.1166/asl.2017.7710 |
| spellingShingle | L Education (General) Idris, M. Abdul Raof, A. H. Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments |
| title | Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments |
| title_full | Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments |
| title_fullStr | Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments |
| title_full_unstemmed | Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments |
| title_short | Common european framework of reference rating scale: scaling its functionality through ESL learners’ self- and peer assessments |
| title_sort | common european framework of reference rating scale scaling its functionality through esl learners self and peer assessments |
| topic | L Education (General) |
| work_keys_str_mv | AT idrism commoneuropeanframeworkofreferenceratingscalescalingitsfunctionalitythroughesllearnersselfandpeerassessments AT abdulraofah commoneuropeanframeworkofreferenceratingscalescalingitsfunctionalitythroughesllearnersselfandpeerassessments |