The accuracy of the cheating detection methods in large-scale tests: mathematics national examination
This study aimed to describe (1) the characteristics of items based on the Item Response Theory, (2) the cheating level in the implementation of the national examinartion based on Angoffs B-Index method, Pair 1 method, Pair 2 method, Modified Error Similarity Analysis (MESA) method, and G2 method, (...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universitas Negeri Yogyakarta
2018-12-01
|
| Series: | Jurnal Penelitian dan Evaluasi Pendidikan |
| Subjects: | |
| Online Access: | https://journal.uny.ac.id/index.php/jpep/article/view/14930 |
| _version_ | 1818195570050727936 |
|---|---|
| author | Thomas Mbenu Nulangi Djemari Mardapi |
| author_facet | Thomas Mbenu Nulangi Djemari Mardapi |
| author_sort | Thomas Mbenu Nulangi |
| collection | DOAJ |
| description | This study aimed to describe (1) the characteristics of items based on the Item Response Theory, (2) the cheating level in the implementation of the national examinartion based on Angoffs B-Index method, Pair 1 method, Pair 2 method, Modified Error Similarity Analysis (MESA) method, and G2 method, (3) the most accurate method to detect the cheating in the mathematics national examination at the senior secondary school level in the academic year of 2015/2016 in East Nusa Tenggara Province. The result of the item response theory analysis showed that 17 (42.5%) items of the mathematics national examination fit with the 3-PL model, with the maximum information function of 58.0128 at 1.6, and the measurement error of 0.1313. The number of pairs detected to be cheating by Angoff’s B-Index method was 63 pairs, that by the Pair 1 method was 52 pairs, that by the Pair 2 method was 141 pairs, that by MESA method was 67 pairs, and that by the G2 method was 183 pairs. The methods which could detect most pairs doing cheating were the G2 method, the Pair 2 method, the MESA method, Angoff’s B-Index method, and the Pair 1 method successively. The methods which could accurately detect cheating based on the computation of the standard error were Angoff’s B-Index method, the G2 method, the MESA method, the Pair 1 method, and the Pair 2 method successively. |
| first_indexed | 2024-12-12T01:20:17Z |
| format | Article |
| id | doaj.art-b6e1422d04b1479480eda40ea9218eb9 |
| institution | Directory Open Access Journal |
| issn | 2338-6061 |
| language | English |
| last_indexed | 2024-12-12T01:20:17Z |
| publishDate | 2018-12-01 |
| publisher | Universitas Negeri Yogyakarta |
| record_format | Article |
| series | Jurnal Penelitian dan Evaluasi Pendidikan |
| spelling | doaj.art-b6e1422d04b1479480eda40ea9218eb92022-12-22T00:43:15ZengUniversitas Negeri YogyakartaJurnal Penelitian dan Evaluasi Pendidikan2338-60612018-12-0122213014210.21831/pep.v22i2.1493011056The accuracy of the cheating detection methods in large-scale tests: mathematics national examinationThomas Mbenu NulangiDjemari MardapiThis study aimed to describe (1) the characteristics of items based on the Item Response Theory, (2) the cheating level in the implementation of the national examinartion based on Angoffs B-Index method, Pair 1 method, Pair 2 method, Modified Error Similarity Analysis (MESA) method, and G2 method, (3) the most accurate method to detect the cheating in the mathematics national examination at the senior secondary school level in the academic year of 2015/2016 in East Nusa Tenggara Province. The result of the item response theory analysis showed that 17 (42.5%) items of the mathematics national examination fit with the 3-PL model, with the maximum information function of 58.0128 at 1.6, and the measurement error of 0.1313. The number of pairs detected to be cheating by Angoff’s B-Index method was 63 pairs, that by the Pair 1 method was 52 pairs, that by the Pair 2 method was 141 pairs, that by MESA method was 67 pairs, and that by the G2 method was 183 pairs. The methods which could detect most pairs doing cheating were the G2 method, the Pair 2 method, the MESA method, Angoff’s B-Index method, and the Pair 1 method successively. The methods which could accurately detect cheating based on the computation of the standard error were Angoff’s B-Index method, the G2 method, the MESA method, the Pair 1 method, and the Pair 2 method successively.https://journal.uny.ac.id/index.php/jpep/article/view/14930national examinationitem characteristicscheating detection methods |
| spellingShingle | Thomas Mbenu Nulangi Djemari Mardapi The accuracy of the cheating detection methods in large-scale tests: mathematics national examination Jurnal Penelitian dan Evaluasi Pendidikan national examination item characteristics cheating detection methods |
| title | The accuracy of the cheating detection methods in large-scale tests: mathematics national examination |
| title_full | The accuracy of the cheating detection methods in large-scale tests: mathematics national examination |
| title_fullStr | The accuracy of the cheating detection methods in large-scale tests: mathematics national examination |
| title_full_unstemmed | The accuracy of the cheating detection methods in large-scale tests: mathematics national examination |
| title_short | The accuracy of the cheating detection methods in large-scale tests: mathematics national examination |
| title_sort | accuracy of the cheating detection methods in large scale tests mathematics national examination |
| topic | national examination item characteristics cheating detection methods |
| url | https://journal.uny.ac.id/index.php/jpep/article/view/14930 |
| work_keys_str_mv | AT thomasmbenunulangi theaccuracyofthecheatingdetectionmethodsinlargescaletestsmathematicsnationalexamination AT djemarimardapi theaccuracyofthecheatingdetectionmethodsinlargescaletestsmathematicsnationalexamination AT thomasmbenunulangi accuracyofthecheatingdetectionmethodsinlargescaletestsmathematicsnationalexamination AT djemarimardapi accuracyofthecheatingdetectionmethodsinlargescaletestsmathematicsnationalexamination |