Applicability of Item Response Theory to the Korean Nurses' Licensing Examination
To test the applicability of item response theory (IRT) to the Korean Nurses' Licensing Examination (KNLE), item analysis was performed after testing the unidimensionality and goodness-of-fit. The results were compared with those based on classical test theory. The results of the 330-item K...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2005-06-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://jeehp.org/upload/jeehp-2-23.pdf |
| _version_ | 1797710752278118400 |
|---|---|
| author | Geum-Hee Jeong Mi Kyoung Yim |
| author_facet | Geum-Hee Jeong Mi Kyoung Yim |
| author_sort | Geum-Hee Jeong |
| collection | DOAJ |
| description | To test the applicability of item response theory (IRT) to the Korean Nurses' Licensing Examination (KNLE), item analysis was performed after testing the unidimensionality and goodness-of-fit. The results were compared with those based on classical test theory. The results of the 330-item KNLE administered to 12,024 examinees in January 2004 were analyzed. Unidimensionality was tested using DETECT and the goodness-of-fit was tested using WINSTEPS for the Rasch model and Bilog-MG for the two-parameter logistic model. Item analysis and ability estimation were done using WINSTEPS. Using DETECT, Dmax ranged from 0.1 to 0.23 for each subject. The mean square value of the infit and outfit values of all items using WINSTEPS ranged from 0.1 to 1.5, except for one item in pediatric nursing, which scored 1.53. Of the 330 items, 218 (42.7%) were misfit using the two-parameter logistic model of Bilog-MG. The correlation coefficients between the difficulty parameter using the Rasch model and the difficulty index from classical test theory ranged from 0.9039 to 0.9699. The correlation between the ability parameter using the Rasch model and the total score from classical test theory ranged from 0.9776 to 0.9984. Therefore, the results of the KNLE fit unidimensionality and goodness-of-fit for the Rasch model. The KNLE should be a good sample for analysis according to the IRT Rasch model, so further research using IRT is possible. |
| first_indexed | 2024-03-12T06:56:49Z |
| format | Article |
| id | doaj.art-208c9c81d6a84a81b44def5497ae599b |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2024-03-12T06:56:49Z |
| publishDate | 2005-06-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-208c9c81d6a84a81b44def5497ae599b2023-09-02T23:59:41ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372005-06-0121232910.3352/jeehp.2005.2.1.2317Applicability of Item Response Theory to the Korean Nurses' Licensing ExaminationGeum-Hee Jeong0Mi Kyoung Yim1Division of Nursing Science, Hallym University, Chuncheon, KoreaInstitute of Medical Education, Hallym University, Chuncheon, KoreaTo test the applicability of item response theory (IRT) to the Korean Nurses' Licensing Examination (KNLE), item analysis was performed after testing the unidimensionality and goodness-of-fit. The results were compared with those based on classical test theory. The results of the 330-item KNLE administered to 12,024 examinees in January 2004 were analyzed. Unidimensionality was tested using DETECT and the goodness-of-fit was tested using WINSTEPS for the Rasch model and Bilog-MG for the two-parameter logistic model. Item analysis and ability estimation were done using WINSTEPS. Using DETECT, Dmax ranged from 0.1 to 0.23 for each subject. The mean square value of the infit and outfit values of all items using WINSTEPS ranged from 0.1 to 1.5, except for one item in pediatric nursing, which scored 1.53. Of the 330 items, 218 (42.7%) were misfit using the two-parameter logistic model of Bilog-MG. The correlation coefficients between the difficulty parameter using the Rasch model and the difficulty index from classical test theory ranged from 0.9039 to 0.9699. The correlation between the ability parameter using the Rasch model and the total score from classical test theory ranged from 0.9776 to 0.9984. Therefore, the results of the KNLE fit unidimensionality and goodness-of-fit for the Rasch model. The KNLE should be a good sample for analysis according to the IRT Rasch model, so further research using IRT is possible.http://jeehp.org/upload/jeehp-2-23.pdfItem Response Theory Classical Test Theory Unidimensionality Goodness-of-fit Rasch Model |
| spellingShingle | Geum-Hee Jeong Mi Kyoung Yim Applicability of Item Response Theory to the Korean Nurses' Licensing Examination Journal of Educational Evaluation for Health Professions Item Response Theory Classical Test Theory Unidimensionality Goodness-of-fit Rasch Model |
| title | Applicability of Item Response Theory to the Korean Nurses' Licensing Examination |
| title_full | Applicability of Item Response Theory to the Korean Nurses' Licensing Examination |
| title_fullStr | Applicability of Item Response Theory to the Korean Nurses' Licensing Examination |
| title_full_unstemmed | Applicability of Item Response Theory to the Korean Nurses' Licensing Examination |
| title_short | Applicability of Item Response Theory to the Korean Nurses' Licensing Examination |
| title_sort | applicability of item response theory to the korean nurses licensing examination |
| topic | Item Response Theory Classical Test Theory Unidimensionality Goodness-of-fit Rasch Model |
| url | http://jeehp.org/upload/jeehp-2-23.pdf |
| work_keys_str_mv | AT geumheejeong applicabilityofitemresponsetheorytothekoreannurseslicensingexamination AT mikyoungyim applicabilityofitemresponsetheorytothekoreannurseslicensingexamination |