Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination
Purpose: The goal of this study was to characterize the difficulty index of the items in the skills test components of the class I and II Korean emergency medical technician licensing examination (KEMTLE), which requires examinees to select items randomly. Methods: The results of 1,309 class I KEMTL...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2016-01-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://www.jeehp.org/upload/pdf/jeehp-13-05.pdf |
| _version_ | 1827246774065037312 |
|---|---|
| author | Bongyeun Koh Sunggi Hong Soon-Sim Kim Jin-Sook Hyun Milye Baek Jundong Moon Hayran Kwon Gyoungyong Kim Seonggi Min Gu-Hyun Kang |
| author_facet | Bongyeun Koh Sunggi Hong Soon-Sim Kim Jin-Sook Hyun Milye Baek Jundong Moon Hayran Kwon Gyoungyong Kim Seonggi Min Gu-Hyun Kang |
| author_sort | Bongyeun Koh |
| collection | DOAJ |
| description | Purpose: The goal of this study was to characterize the difficulty index of the items in the skills test components of the class I and II Korean emergency medical technician licensing examination (KEMTLE), which requires examinees to select items randomly. Methods: The results of 1,309 class I KEMTLE examinations and 1,801 class II KEMTLE examinations in 2013 were subjected to analysis. Items from the basic and advanced skills test sections of the KEMTLE were compared to determine whether some were significantly more difficult than others. Results: In the class I KEMTLE, all 4 of the items on the basic skills test showed significant variation in difficulty index (P<0.01), as well as 4 of the 5 items on the advanced skills test (P<0.05). In the class II KEMTLE, 4 of the 5 items on the basic skills test showed significantly different difficulty index (P<0.01), as well as all 3 of the advanced skills test items (P<0.01). Conclusion: In the skills test components of the class I and II KEMTLE, the procedure in which examinees randomly select questions should be revised to require examinees to respond to a set of fixed items in order to improve the reliability of the national licensing examination. |
| first_indexed | 2024-03-12T06:18:20Z |
| format | Article |
| id | doaj.art-ffefbe0cad54443e84792c57cb5b2873 |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2025-03-21T23:05:18Z |
| publishDate | 2016-01-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-ffefbe0cad54443e84792c57cb5b28732024-05-22T07:02:06ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372016-01-011310.3352/jeehp.2016.13.5190Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examinationBongyeun Koh0Sunggi Hong1Soon-Sim Kim2Jin-Sook Hyun3Milye Baek4Jundong Moon5Hayran Kwon6Gyoungyong Kim7Seonggi Min8Gu-Hyun Kang9 Dongnam Health University, Suwon, Korea Dongnam Health University, Suwon, Korea Sunlin University, Pohang, Korea Sunlin University, Pohang, Korea Korea National University of Transportation, Chungju, Korea Kongju National University, Gongju, Korea Gwangju Health University, Gwangju, Korea Yangpyeong Fire Station, Gyeonggi-do, Korea Korea Coast Guard Academy, Jeollanam-do, Korea Kangnam Sacred Heart Hospital, Hallym University, Seoul, KoreaPurpose: The goal of this study was to characterize the difficulty index of the items in the skills test components of the class I and II Korean emergency medical technician licensing examination (KEMTLE), which requires examinees to select items randomly. Methods: The results of 1,309 class I KEMTLE examinations and 1,801 class II KEMTLE examinations in 2013 were subjected to analysis. Items from the basic and advanced skills test sections of the KEMTLE were compared to determine whether some were significantly more difficult than others. Results: In the class I KEMTLE, all 4 of the items on the basic skills test showed significant variation in difficulty index (P<0.01), as well as 4 of the 5 items on the advanced skills test (P<0.05). In the class II KEMTLE, 4 of the 5 items on the basic skills test showed significantly different difficulty index (P<0.01), as well as all 3 of the advanced skills test items (P<0.01). Conclusion: In the skills test components of the class I and II KEMTLE, the procedure in which examinees randomly select questions should be revised to require examinees to respond to a set of fixed items in order to improve the reliability of the national licensing examination.http://www.jeehp.org/upload/pdf/jeehp-13-05.pdfemergency medical technicians, itemkorea, licensurereliability |
| spellingShingle | Bongyeun Koh Sunggi Hong Soon-Sim Kim Jin-Sook Hyun Milye Baek Jundong Moon Hayran Kwon Gyoungyong Kim Seonggi Min Gu-Hyun Kang Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination Journal of Educational Evaluation for Health Professions emergency medical technicians, item korea, licensure reliability |
| title | Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination |
| title_full | Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination |
| title_fullStr | Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination |
| title_full_unstemmed | Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination |
| title_short | Varying levels of difficulty index of skills-test items randomly selected by examinees on the Korean emergency medical technician licensing examination |
| title_sort | varying levels of difficulty index of skills test items randomly selected by examinees on the korean emergency medical technician licensing examination |
| topic | emergency medical technicians, item korea, licensure reliability |
| url | http://www.jeehp.org/upload/pdf/jeehp-13-05.pdf |
| work_keys_str_mv | AT bongyeunkoh varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT sunggihong varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT soonsimkim varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT jinsookhyun varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT milyebaek varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT jundongmoon varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT hayrankwon varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT gyoungyongkim varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT seonggimin varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination AT guhyunkang varyinglevelsofdifficultyindexofskillstestitemsrandomlyselectedbyexamineesonthekoreanemergencymedicaltechnicianlicensingexamination |