Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review

The Common European Framework of Reference for Languages (CEFR) has provided a flexible framework for constructing and implementing language tests. Its flexibility has led to the development of various CEFR-aligned language tests that attempted to conform to its framework. The variability in test pu...

Full description

Bibliographic Details
Main Authors: Nik Aloesnita, Nik Mohd Alwi, Wan Alisa Hanis, Wan Abdul Halim
Format: Article
Language:English
Published: Universiti Teknologi MARA Kedah 2024
Subjects:
Online Access:http://umpir.ump.edu.my/id/eprint/41411/1/CPLT%2012%281%29.pdf
_version_ 1811138419292635136
author Nik Aloesnita, Nik Mohd Alwi
Wan Alisa Hanis, Wan Abdul Halim
author_facet Nik Aloesnita, Nik Mohd Alwi
Wan Alisa Hanis, Wan Abdul Halim
author_sort Nik Aloesnita, Nik Mohd Alwi
collection UMP
description The Common European Framework of Reference for Languages (CEFR) has provided a flexible framework for constructing and implementing language tests. Its flexibility has led to the development of various CEFR-aligned language tests that attempted to conform to its framework. The variability in test purpose, quality, and difficulty has necessitated the use of different methodological decisions when conducting studies on CEFR-aligned language tests. The current study employed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to conduct a present systematic review. A total of 31 journal articles on CEFR-aligned language tests were used to explore the methods employed in the articles. The review identified six prominent discoveries: the study method, data analysis, participant characteristics, rater participation, number of essays, and writing genres. The current study revealed the prevalence of quantitative methods, the focus on specific participant characteristics, the inclusion of many raters and essays, and the inclination towards two dominant writing genres in studies on CEFR-aligned language tests. By discovering the shared methodological components adopted in current CEFR-aligned language studies, this study guides researchers and practitioners in enhancing the validity, reliability, and generalisability of studies on CEFR-aligned language tests in various contexts through successful replicability.
first_indexed 2024-09-25T03:49:53Z
format Article
id UMPir41411
institution Universiti Malaysia Pahang
language English
last_indexed 2024-09-25T03:49:53Z
publishDate 2024
publisher Universiti Teknologi MARA Kedah
record_format dspace
spelling UMPir414112024-05-28T00:34:49Z http://umpir.ump.edu.my/id/eprint/41411/ Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review Nik Aloesnita, Nik Mohd Alwi Wan Alisa Hanis, Wan Abdul Halim PE English The Common European Framework of Reference for Languages (CEFR) has provided a flexible framework for constructing and implementing language tests. Its flexibility has led to the development of various CEFR-aligned language tests that attempted to conform to its framework. The variability in test purpose, quality, and difficulty has necessitated the use of different methodological decisions when conducting studies on CEFR-aligned language tests. The current study employed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to conduct a present systematic review. A total of 31 journal articles on CEFR-aligned language tests were used to explore the methods employed in the articles. The review identified six prominent discoveries: the study method, data analysis, participant characteristics, rater participation, number of essays, and writing genres. The current study revealed the prevalence of quantitative methods, the focus on specific participant characteristics, the inclusion of many raters and essays, and the inclination towards two dominant writing genres in studies on CEFR-aligned language tests. By discovering the shared methodological components adopted in current CEFR-aligned language studies, this study guides researchers and practitioners in enhancing the validity, reliability, and generalisability of studies on CEFR-aligned language tests in various contexts through successful replicability. Universiti Teknologi MARA Kedah 2024 Article PeerReviewed pdf en http://umpir.ump.edu.my/id/eprint/41411/1/CPLT%2012%281%29.pdf Nik Aloesnita, Nik Mohd Alwi and Wan Alisa Hanis, Wan Abdul Halim (2024) Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review. Journal of Creative Practices in Language Learning and Teaching (CPLT), 12 (1). pp. 1-16. ISSN 1823-464X. (Published) https://cplt.uitm.edu.my/v1/images/v12n1/9_Variations_and_Methodological.pdf
spellingShingle PE English
Nik Aloesnita, Nik Mohd Alwi
Wan Alisa Hanis, Wan Abdul Halim
Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review
title Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review
title_full Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review
title_fullStr Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review
title_full_unstemmed Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review
title_short Variations and Methodological Components in CEFR-Aligned Language Tests: A Systematic Review
title_sort variations and methodological components in cefr aligned language tests a systematic review
topic PE English
url http://umpir.ump.edu.my/id/eprint/41411/1/CPLT%2012%281%29.pdf
work_keys_str_mv AT nikaloesnitanikmohdalwi variationsandmethodologicalcomponentsincefralignedlanguagetestsasystematicreview
AT wanalisahaniswanabdulhalim variationsandmethodologicalcomponentsincefralignedlanguagetestsasystematicreview