EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS
The outbreak of the COVID-19 pandemic has transformed the educational landscape in a way unseen before. Educational institutions are navigating between offline and online learning worldwide. Computer-based testing is rapidly taking over paper-and-pencil testing as the dominant mode of assessment. In...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Association for the Teaching of English as a Foreign Language in Indonesia (TEFLIN)
2023-10-01
|
| Series: | TEFLIN Journal |
| Subjects: | |
| Online Access: | https://journal.teflin.org/index.php/journal/article/view/2428 |
| _version_ | 1797648800847757312 |
|---|---|
| author | Muhammad Yoga Prabowo Sarah Rahmadian |
| author_facet | Muhammad Yoga Prabowo Sarah Rahmadian |
| author_sort | Muhammad Yoga Prabowo |
| collection | DOAJ |
| description | The outbreak of the COVID-19 pandemic has transformed the educational landscape in a way unseen before. Educational institutions are navigating between offline and online learning worldwide. Computer-based testing is rapidly taking over paper-and-pencil testing as the dominant mode of assessment. In some settings, computer-based and paper-and-pencil assessments can also be offered side-by-side, in which case test developers should ensure the evidence of equivalence between both versions. This study aims to establish the equivalency evidence of different delivery modes of the English Competency Test, an English language assessment for civil service officers developed and used by the Human Resources Development Education and Training Center, a civil service training institution under the Ministry of Finance of the Republic of Indonesia. Psychometric analyses were carried out with the Rasch model to measure the unidimensionality, reliability, separation, and standard error of measurement estimates. The findings demonstrate that the paper-and-pencil and computer-based versions of the language assessment exhibit comparatively equivalent psychometric properties. The computer-based version of the English Competency Test is proven to offer a reliable and comparable alternative to the paper-and-pencil version. |
| first_indexed | 2024-03-11T15:37:16Z |
| format | Article |
| id | doaj.art-6dadb9bd5f3947bbaf1d113aba130655 |
| institution | Directory Open Access Journal |
| issn | 0215-773X 2356-2641 |
| language | English |
| last_indexed | 2024-03-11T15:37:16Z |
| publishDate | 2023-10-01 |
| publisher | Association for the Teaching of English as a Foreign Language in Indonesia (TEFLIN) |
| record_format | Article |
| series | TEFLIN Journal |
| spelling | doaj.art-6dadb9bd5f3947bbaf1d113aba1306552023-10-26T14:36:11ZengAssociation for the Teaching of English as a Foreign Language in Indonesia (TEFLIN)TEFLIN Journal0215-773X2356-26412023-10-0134210.15639/teflinjournal.v34i2/301-319EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSISMuhammad Yoga Prabowo0Sarah Rahmadian1University of MelbourneFinancial Education and Training AgencyThe outbreak of the COVID-19 pandemic has transformed the educational landscape in a way unseen before. Educational institutions are navigating between offline and online learning worldwide. Computer-based testing is rapidly taking over paper-and-pencil testing as the dominant mode of assessment. In some settings, computer-based and paper-and-pencil assessments can also be offered side-by-side, in which case test developers should ensure the evidence of equivalence between both versions. This study aims to establish the equivalency evidence of different delivery modes of the English Competency Test, an English language assessment for civil service officers developed and used by the Human Resources Development Education and Training Center, a civil service training institution under the Ministry of Finance of the Republic of Indonesia. Psychometric analyses were carried out with the Rasch model to measure the unidimensionality, reliability, separation, and standard error of measurement estimates. The findings demonstrate that the paper-and-pencil and computer-based versions of the language assessment exhibit comparatively equivalent psychometric properties. The computer-based version of the English Competency Test is proven to offer a reliable and comparable alternative to the paper-and-pencil version.https://journal.teflin.org/index.php/journal/article/view/2428computer-based testingmode effectspaper-and-pencil testingpsychometric propertiesRasch model |
| spellingShingle | Muhammad Yoga Prabowo Sarah Rahmadian EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS TEFLIN Journal computer-based testing mode effects paper-and-pencil testing psychometric properties Rasch model |
| title | EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS |
| title_full | EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS |
| title_fullStr | EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS |
| title_full_unstemmed | EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS |
| title_short | EQUIVALENCY EVIDENCE OF THE ENGLISH COMPETENCY TEST ACROSS DIFFERENT MODES: A RASCH ANALYSIS |
| title_sort | equivalency evidence of the english competency test across different modes a rasch analysis |
| topic | computer-based testing mode effects paper-and-pencil testing psychometric properties Rasch model |
| url | https://journal.teflin.org/index.php/journal/article/view/2428 |
| work_keys_str_mv | AT muhammadyogaprabowo equivalencyevidenceoftheenglishcompetencytestacrossdifferentmodesaraschanalysis AT sarahrahmadian equivalencyevidenceoftheenglishcompetencytestacrossdifferentmodesaraschanalysis |