The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination
Purpose Smart device-based testing (SBT) is being introduced into the Republic of Korea’s high-stakes examination system, starting with the Korean Emergency Medicine Technician Licensing Examination (KEMTLE) in December 2017. In order to minimize the effects of variation in examinees’ environment on...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2018-12-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://www.jeehp.org/upload/jeehp-15-33.pdf |
| _version_ | 1797707433303343104 |
|---|---|
| author | Eun Young Lim Mi Kyoung Yim Sun Huh |
| author_facet | Eun Young Lim Mi Kyoung Yim Sun Huh |
| author_sort | Eun Young Lim |
| collection | DOAJ |
| description | Purpose Smart device-based testing (SBT) is being introduced into the Republic of Korea’s high-stakes examination system, starting with the Korean Emergency Medicine Technician Licensing Examination (KEMTLE) in December 2017. In order to minimize the effects of variation in examinees’ environment on test scores, this study aimed to identify any associations of variables related to examinees’ individual characteristics and their perceived acceptability of SBT with their SBT practice test scores. Methods Of the 569 candidate students who took the KEMTLE on September 12, 2015, 560 responded to a survey questionnaire on the acceptability of SBT after the examination. The questionnaire addressed 8 individual characteristics and contained 2 satisfaction, 9 convenience, and 9 preference items. A comparative analysis according to individual variables was performed. Furthermore, a generalized linear model (GLM) analysis was conducted to identify the effects of individual characteristics and perceived acceptability of SBT on test scores. Results Among those who preferred SBT over paper-and-pencil testing, test scores were higher for male participants (mean± standard deviation [SD], 4.36± 0.72) than for female participants (mean± SD, 4.21± 0.73). According to the GLM, no variables evaluated— including gender and experience with computer-based testing, SBT, or using a tablet PC—showed a statistically significant relationship with the total score, scores on multimedia items, or scores on text items. Conclusion Individual characteristics and perceived acceptability of SBT did not affect the SBT practice test scores of emergency medicine technician students in Korea. It should be possible to adopt SBT for the KEMTLE without interference from the variables examined in this study. |
| first_indexed | 2024-03-12T06:06:20Z |
| format | Article |
| id | doaj.art-065b7ed947764fb083d698525b3bdbb4 |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2024-03-12T06:06:20Z |
| publishDate | 2018-12-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-065b7ed947764fb083d698525b3bdbb42023-09-03T03:31:24ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372018-12-011510.3352/jeehp.2018.15.33303The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing ExaminationEun Young Lim0Mi Kyoung Yim1Sun Huh2Division of Educational Evaluation, Korea Institute for Curriculum and Evaluation, Jincheon, KoreaResearch and Development Division, Korea Health Personnel Licensing Examination Institute, Seoul, KoreaDepartment of Parasitology and Institute of Medical Education, College of Medicine, Hallym University, Chuncheon, KoreaPurpose Smart device-based testing (SBT) is being introduced into the Republic of Korea’s high-stakes examination system, starting with the Korean Emergency Medicine Technician Licensing Examination (KEMTLE) in December 2017. In order to minimize the effects of variation in examinees’ environment on test scores, this study aimed to identify any associations of variables related to examinees’ individual characteristics and their perceived acceptability of SBT with their SBT practice test scores. Methods Of the 569 candidate students who took the KEMTLE on September 12, 2015, 560 responded to a survey questionnaire on the acceptability of SBT after the examination. The questionnaire addressed 8 individual characteristics and contained 2 satisfaction, 9 convenience, and 9 preference items. A comparative analysis according to individual variables was performed. Furthermore, a generalized linear model (GLM) analysis was conducted to identify the effects of individual characteristics and perceived acceptability of SBT on test scores. Results Among those who preferred SBT over paper-and-pencil testing, test scores were higher for male participants (mean± standard deviation [SD], 4.36± 0.72) than for female participants (mean± SD, 4.21± 0.73). According to the GLM, no variables evaluated— including gender and experience with computer-based testing, SBT, or using a tablet PC—showed a statistically significant relationship with the total score, scores on multimedia items, or scores on text items. Conclusion Individual characteristics and perceived acceptability of SBT did not affect the SBT practice test scores of emergency medicine technician students in Korea. It should be possible to adopt SBT for the KEMTLE without interference from the variables examined in this study.http://www.jeehp.org/upload/jeehp-15-33.pdfemergency medical technicianslicensurelinear modelspersonal satisfactionstudentsrepublic of korea |
| spellingShingle | Eun Young Lim Mi Kyoung Yim Sun Huh The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination Journal of Educational Evaluation for Health Professions emergency medical technicians licensure linear models personal satisfaction students republic of korea |
| title | The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination |
| title_full | The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination |
| title_fullStr | The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination |
| title_full_unstemmed | The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination |
| title_short | The relationship of examinees’ individual characteristics and perceived acceptability of smart device-based testing to test scores on the practice test of the Korea Emergency Medicine Technician Licensing Examination |
| title_sort | relationship of examinees individual characteristics and perceived acceptability of smart device based testing to test scores on the practice test of the korea emergency medicine technician licensing examination |
| topic | emergency medical technicians licensure linear models personal satisfaction students republic of korea |
| url | http://www.jeehp.org/upload/jeehp-15-33.pdf |
| work_keys_str_mv | AT eunyounglim therelationshipofexamineesindividualcharacteristicsandperceivedacceptabilityofsmartdevicebasedtestingtotestscoresonthepracticetestofthekoreaemergencymedicinetechnicianlicensingexamination AT mikyoungyim therelationshipofexamineesindividualcharacteristicsandperceivedacceptabilityofsmartdevicebasedtestingtotestscoresonthepracticetestofthekoreaemergencymedicinetechnicianlicensingexamination AT sunhuh therelationshipofexamineesindividualcharacteristicsandperceivedacceptabilityofsmartdevicebasedtestingtotestscoresonthepracticetestofthekoreaemergencymedicinetechnicianlicensingexamination AT eunyounglim relationshipofexamineesindividualcharacteristicsandperceivedacceptabilityofsmartdevicebasedtestingtotestscoresonthepracticetestofthekoreaemergencymedicinetechnicianlicensingexamination AT mikyoungyim relationshipofexamineesindividualcharacteristicsandperceivedacceptabilityofsmartdevicebasedtestingtotestscoresonthepracticetestofthekoreaemergencymedicinetechnicianlicensingexamination AT sunhuh relationshipofexamineesindividualcharacteristicsandperceivedacceptabilityofsmartdevicebasedtestingtotestscoresonthepracticetestofthekoreaemergencymedicinetechnicianlicensingexamination |