Revealing the characteristics of Indonesian language test used in the national-standardized school examinations

This study aimed to determine the characteristics of Indonesian language test used in the national standardized school examinations (Ujian Sekolah Berstandar Nasional, USBN). We used the response data of 218 students from a public senior high school in the Special Region of Yogyakarta, Indonesia, to...

Full description

Bibliographic Details
Main Authors: Marwah Ulwatunnisa, Heri Retnawati, Muhardis Muhardis, Eri Yusron
Format: Article
Language:English
Published: Universitas Negeri Yogyakarta 2024-01-01
Series:REID (Research and Evaluation in Education)
Subjects:
Online Access:https://journal.uny.ac.id/index.php/reid/article/view/31999
_version_ 1797280400329932800
author Marwah Ulwatunnisa
Heri Retnawati
Muhardis Muhardis
Eri Yusron
author_facet Marwah Ulwatunnisa
Heri Retnawati
Muhardis Muhardis
Eri Yusron
author_sort Marwah Ulwatunnisa
collection DOAJ
description This study aimed to determine the characteristics of Indonesian language test used in the national standardized school examinations (Ujian Sekolah Berstandar Nasional, USBN). We used the response data of 218 students from a public senior high school in the Special Region of Yogyakarta, Indonesia, to the test consisting of two packages, A and B, in the 2018/2019 academic year to investigate the characteristics of the test and its items. Quantitative analysis using classical test theory (CTT) and one-parameter logistic item response theory (1-PL IRT) model was conducted to investigate the characteristics of the test and its items based on difficulty and discriminating power. The results of the study under the CTT showed that most test items in both package A and package B have difficulty in the easy category and the portion of items in the difficult category is no more than 10%. In addition, while the majority of test items in both test packages demonstrated good discriminating power, package B contained a high number of items with poor discriminating power (47.5%). Under 1-PL IRT, our study results indicated the dominance of items with difficulty level in the moderate category in both test packages. In addition to revealing the difficulty level of the test items, our study showed that the items in the difficult category under CTT and IRT were related to the topics of types of conjunction; spelling, grammar, and sentence structure; job application letter; and observation report text and its structure. The results of this study are expected to contribute to improving the quality of the Indonesian language test and the quality of learning on topics where students have difficulty based on test items in the difficult category.
first_indexed 2024-03-07T16:39:43Z
format Article
id doaj.art-bc31f4d3d92741a1a51712721f10bf77
institution Directory Open Access Journal
issn 2460-6995
language English
last_indexed 2024-03-07T16:39:43Z
publishDate 2024-01-01
publisher Universitas Negeri Yogyakarta
record_format Article
series REID (Research and Evaluation in Education)
spelling doaj.art-bc31f4d3d92741a1a51712721f10bf772024-03-03T08:40:46ZengUniversitas Negeri YogyakartaREID (Research and Evaluation in Education)2460-69952024-01-019221022210.21831/reid.v9i2.3199919306Revealing the characteristics of Indonesian language test used in the national-standardized school examinationsMarwah Ulwatunnisa0Heri Retnawati1Muhardis Muhardis2Eri Yusron3Universitas Negeri YogyakartaUniversitas Negeri YogyakartaBadan Riset dan Inovasi Nasional (BRIN)Universitas Negeri Yogyakarta; Pusat Studi Pendidikan dan Kebijakan (PSPK)This study aimed to determine the characteristics of Indonesian language test used in the national standardized school examinations (Ujian Sekolah Berstandar Nasional, USBN). We used the response data of 218 students from a public senior high school in the Special Region of Yogyakarta, Indonesia, to the test consisting of two packages, A and B, in the 2018/2019 academic year to investigate the characteristics of the test and its items. Quantitative analysis using classical test theory (CTT) and one-parameter logistic item response theory (1-PL IRT) model was conducted to investigate the characteristics of the test and its items based on difficulty and discriminating power. The results of the study under the CTT showed that most test items in both package A and package B have difficulty in the easy category and the portion of items in the difficult category is no more than 10%. In addition, while the majority of test items in both test packages demonstrated good discriminating power, package B contained a high number of items with poor discriminating power (47.5%). Under 1-PL IRT, our study results indicated the dominance of items with difficulty level in the moderate category in both test packages. In addition to revealing the difficulty level of the test items, our study showed that the items in the difficult category under CTT and IRT were related to the topics of types of conjunction; spelling, grammar, and sentence structure; job application letter; and observation report text and its structure. The results of this study are expected to contribute to improving the quality of the Indonesian language test and the quality of learning on topics where students have difficulty based on test items in the difficult category.https://journal.uny.ac.id/index.php/reid/article/view/31999discriminating powerindonesian language testitem difficultyschool examinationsstandardized test
spellingShingle Marwah Ulwatunnisa
Heri Retnawati
Muhardis Muhardis
Eri Yusron
Revealing the characteristics of Indonesian language test used in the national-standardized school examinations
REID (Research and Evaluation in Education)
discriminating power
indonesian language test
item difficulty
school examinations
standardized test
title Revealing the characteristics of Indonesian language test used in the national-standardized school examinations
title_full Revealing the characteristics of Indonesian language test used in the national-standardized school examinations
title_fullStr Revealing the characteristics of Indonesian language test used in the national-standardized school examinations
title_full_unstemmed Revealing the characteristics of Indonesian language test used in the national-standardized school examinations
title_short Revealing the characteristics of Indonesian language test used in the national-standardized school examinations
title_sort revealing the characteristics of indonesian language test used in the national standardized school examinations
topic discriminating power
indonesian language test
item difficulty
school examinations
standardized test
url https://journal.uny.ac.id/index.php/reid/article/view/31999
work_keys_str_mv AT marwahulwatunnisa revealingthecharacteristicsofindonesianlanguagetestusedinthenationalstandardizedschoolexaminations
AT heriretnawati revealingthecharacteristicsofindonesianlanguagetestusedinthenationalstandardizedschoolexaminations
AT muhardismuhardis revealingthecharacteristicsofindonesianlanguagetestusedinthenationalstandardizedschoolexaminations
AT eriyusron revealingthecharacteristicsofindonesianlanguagetestusedinthenationalstandardizedschoolexaminations