Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination
Purpose This study aimed to identify the best way of developing equivalent item sets and to propose a stable and effective management plan for periodical licensing examinations. Methods Five pre-equated item sets were developed based on the predicted correct answer rate of each item using linear pro...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2018-10-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://www.jeehp.org/upload/jeehp-15-26.pdf |
| _version_ | 1797714062799273984 |
|---|---|
| author | Dong Gi Seo Myeong Gi Kim Na Hui Kim Hye Sook Shin Hyun Jung Kim |
| author_facet | Dong Gi Seo Myeong Gi Kim Na Hui Kim Hye Sook Shin Hyun Jung Kim |
| author_sort | Dong Gi Seo |
| collection | DOAJ |
| description | Purpose This study aimed to identify the best way of developing equivalent item sets and to propose a stable and effective management plan for periodical licensing examinations. Methods Five pre-equated item sets were developed based on the predicted correct answer rate of each item using linear programming. These pre-equated item sets were compared to the ones that were developed with a random item selection method based on the actual correct answer rate (ACAR) and difficulty from item response theory (IRT). The results with and without common items were also compared in the same way. ACAR and the IRT difficulty were used to determine whether there was a significant difference between the pre-equating conditions. Results There was a statistically significant difference in IRT difficulty among the results from different pre-equated conditions. The predicted correct answer rate was divided using 2 or 3 difficulty categories, and the ACAR and IRT difficulty parameters of the 5 item sets were equally constructed. Comparing the item set conditions with and without common items, including common items did not make a significant contribution to the equating of the 5 item sets. Conclusion This study suggested that the linear programming method is applicable to construct equated-item sets that reflect each content area. The suggested best method to construct equated item sets is to divide the predicted correct answer rate using 2 or 3 difficulty categories, regardless of common items. If pre-equated item sets are required to construct a test based on the actual data, several methods should be considered by simulation studies to determine which is optimal before administering a real test. |
| first_indexed | 2024-03-12T07:46:26Z |
| format | Article |
| id | doaj.art-fe5c5cb9185a4cc9a68ce17ed6f1e578 |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2024-03-12T07:46:26Z |
| publishDate | 2018-10-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-fe5c5cb9185a4cc9a68ce17ed6f1e5782023-09-02T21:00:23ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372018-10-011510.3352/jeehp.2018.15.26296Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing ExaminationDong Gi Seo0Myeong Gi Kim1Na Hui Kim2Hye Sook Shin3Hyun Jung Kim4Department of Psychology, College of Social Science, Hallym University, Chuncheon, KoreaDepartment of Psychology, College of Social Science, Hallym University, Chuncheon, KoreaDepartment of Psychology, College of Social Science, Hallym University, Chuncheon, KoreaDepartment of Education, College of Education, Kangwon National University, Chuncheon, KoreaDivision of Nursing, Hallym University, Chuncheon, KoreaPurpose This study aimed to identify the best way of developing equivalent item sets and to propose a stable and effective management plan for periodical licensing examinations. Methods Five pre-equated item sets were developed based on the predicted correct answer rate of each item using linear programming. These pre-equated item sets were compared to the ones that were developed with a random item selection method based on the actual correct answer rate (ACAR) and difficulty from item response theory (IRT). The results with and without common items were also compared in the same way. ACAR and the IRT difficulty were used to determine whether there was a significant difference between the pre-equating conditions. Results There was a statistically significant difference in IRT difficulty among the results from different pre-equated conditions. The predicted correct answer rate was divided using 2 or 3 difficulty categories, and the ACAR and IRT difficulty parameters of the 5 item sets were equally constructed. Comparing the item set conditions with and without common items, including common items did not make a significant contribution to the equating of the 5 item sets. Conclusion This study suggested that the linear programming method is applicable to construct equated-item sets that reflect each content area. The suggested best method to construct equated item sets is to divide the predicted correct answer rate using 2 or 3 difficulty categories, regardless of common items. If pre-equated item sets are required to construct a test based on the actual data, several methods should be considered by simulation studies to determine which is optimal before administering a real test.http://www.jeehp.org/upload/jeehp-15-26.pdfkorea medical licensing examinationperiodical examinationlinear programmingpredicted correct answer rateactual answer rate |
| spellingShingle | Dong Gi Seo Myeong Gi Kim Na Hui Kim Hye Sook Shin Hyun Jung Kim Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination Journal of Educational Evaluation for Health Professions korea medical licensing examination periodical examination linear programming predicted correct answer rate actual answer rate |
| title | Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination |
| title_full | Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination |
| title_fullStr | Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination |
| title_full_unstemmed | Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination |
| title_short | Linear programming method to construct equated item sets for the implementation of periodical computer-based testing for the Korean Medical Licensing Examination |
| title_sort | linear programming method to construct equated item sets for the implementation of periodical computer based testing for the korean medical licensing examination |
| topic | korea medical licensing examination periodical examination linear programming predicted correct answer rate actual answer rate |
| url | http://www.jeehp.org/upload/jeehp-15-26.pdf |
| work_keys_str_mv | AT donggiseo linearprogrammingmethodtoconstructequateditemsetsfortheimplementationofperiodicalcomputerbasedtestingforthekoreanmedicallicensingexamination AT myeonggikim linearprogrammingmethodtoconstructequateditemsetsfortheimplementationofperiodicalcomputerbasedtestingforthekoreanmedicallicensingexamination AT nahuikim linearprogrammingmethodtoconstructequateditemsetsfortheimplementationofperiodicalcomputerbasedtestingforthekoreanmedicallicensingexamination AT hyesookshin linearprogrammingmethodtoconstructequateditemsetsfortheimplementationofperiodicalcomputerbasedtestingforthekoreanmedicallicensingexamination AT hyunjungkim linearprogrammingmethodtoconstructequateditemsetsfortheimplementationofperiodicalcomputerbasedtestingforthekoreanmedicallicensingexamination |