An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study
Purpose Lack of confidence in suturing/ligature skills due to insufficient practice and assessments is common among novice Chinese medical interns. This study aimed to improve the skill acquisition of medical interns through a new intervention program. Methods In addition to regular clinical trainin...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2019-04-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://www.jeehp.org/upload/jeehp-16-07.pdf |
| _version_ | 1797714005937094656 |
|---|---|
| author | Ying-Ying Yang Boaz Shulruf |
| author_facet | Ying-Ying Yang Boaz Shulruf |
| author_sort | Ying-Ying Yang |
| collection | DOAJ |
| description | Purpose Lack of confidence in suturing/ligature skills due to insufficient practice and assessments is common among novice Chinese medical interns. This study aimed to improve the skill acquisition of medical interns through a new intervention program. Methods In addition to regular clinical training, expert-led or expert-led plus artificial intelligence (AI) system tutoring courses were implemented during the first 2 weeks of the surgical block. Interns could voluntarily join the regular (no additional tutoring), expert-led tutoring, or expert-led+AI tutoring groups freely. In the regular group, interns (n=25) did not receive additional tutoring. The expert-led group received 3-hour expert-led tutoring and in-training formative assessments after 2 practice sessions. After a similar expert-led course, the expert-led+AI group (n=23) practiced and assessed their skills on an AI system. Through a comparison with the internal standard, the system automatically recorded and evaluated every intern’s suturing/ligature skills. In the expert-led+AI group, performance and confidence were compared between interns who participated in 1, 2, or 3 AI practice sessions. Results The end-of-surgical block objective structured clinical examination (OSCE) performance and self-assessed confidence in suturing/ligature skills were highest in the expert-led+AI group. In comparison with the expert-led group, the expert-led+AI group showed similar performance in the in-training assessment and greater improvement in the end-of-surgical block OSCE. In the expert-led+AI group, the best performance and highest post-OSCE confidence were noted in those who engaged in 3 AI practice sessions. Conclusion This pilot study demonstrated the potential value of incorporating an additional expert-led+AI system–assisted tutoring course into the regular surgical curriculum. |
| first_indexed | 2024-03-12T07:45:36Z |
| format | Article |
| id | doaj.art-2ec6b172b3d54f4f9736461a3cf225c1 |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2024-03-12T07:45:36Z |
| publishDate | 2019-04-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-2ec6b172b3d54f4f9736461a3cf225c12023-09-02T21:00:23ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372019-04-011610.3352/jeehp.2019.16.7314An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot studyYing-Ying Yang0Boaz Shulruf1Division of Clinical Skills Training and High-fidelity Medical Simulation for Holistic Care and Inter-Professional Collaboration, Department of Medical Education, Taipei Veterans General Hospital, Taipei, TaiwanOffice of Medical Education, University of New South Wales Australia, Sydney, AustraliaPurpose Lack of confidence in suturing/ligature skills due to insufficient practice and assessments is common among novice Chinese medical interns. This study aimed to improve the skill acquisition of medical interns through a new intervention program. Methods In addition to regular clinical training, expert-led or expert-led plus artificial intelligence (AI) system tutoring courses were implemented during the first 2 weeks of the surgical block. Interns could voluntarily join the regular (no additional tutoring), expert-led tutoring, or expert-led+AI tutoring groups freely. In the regular group, interns (n=25) did not receive additional tutoring. The expert-led group received 3-hour expert-led tutoring and in-training formative assessments after 2 practice sessions. After a similar expert-led course, the expert-led+AI group (n=23) practiced and assessed their skills on an AI system. Through a comparison with the internal standard, the system automatically recorded and evaluated every intern’s suturing/ligature skills. In the expert-led+AI group, performance and confidence were compared between interns who participated in 1, 2, or 3 AI practice sessions. Results The end-of-surgical block objective structured clinical examination (OSCE) performance and self-assessed confidence in suturing/ligature skills were highest in the expert-led+AI group. In comparison with the expert-led group, the expert-led+AI group showed similar performance in the in-training assessment and greater improvement in the end-of-surgical block OSCE. In the expert-led+AI group, the best performance and highest post-OSCE confidence were noted in those who engaged in 3 AI practice sessions. Conclusion This pilot study demonstrated the potential value of incorporating an additional expert-led+AI system–assisted tutoring course into the regular surgical curriculum.http://www.jeehp.org/upload/jeehp-16-07.pdfartificial intelligencesuturing and ligature skillstutoring coursetaiwan |
| spellingShingle | Ying-Ying Yang Boaz Shulruf An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study Journal of Educational Evaluation for Health Professions artificial intelligence suturing and ligature skills tutoring course taiwan |
| title | An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study |
| title_full | An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study |
| title_fullStr | An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study |
| title_full_unstemmed | An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study |
| title_short | An expert-led and artificial intelligence system-assisted tutoring course to improve the confidence of Chinese medical interns in suturing and ligature skills: a prospective pilot study |
| title_sort | expert led and artificial intelligence system assisted tutoring course to improve the confidence of chinese medical interns in suturing and ligature skills a prospective pilot study |
| topic | artificial intelligence suturing and ligature skills tutoring course taiwan |
| url | http://www.jeehp.org/upload/jeehp-16-07.pdf |
| work_keys_str_mv | AT yingyingyang anexpertledandartificialintelligencesystemassistedtutoringcoursetoimprovetheconfidenceofchinesemedicalinternsinsuturingandligatureskillsaprospectivepilotstudy AT boazshulruf anexpertledandartificialintelligencesystemassistedtutoringcoursetoimprovetheconfidenceofchinesemedicalinternsinsuturingandligatureskillsaprospectivepilotstudy AT yingyingyang expertledandartificialintelligencesystemassistedtutoringcoursetoimprovetheconfidenceofchinesemedicalinternsinsuturingandligatureskillsaprospectivepilotstudy AT boazshulruf expertledandartificialintelligencesystemassistedtutoringcoursetoimprovetheconfidenceofchinesemedicalinternsinsuturingandligatureskillsaprospectivepilotstudy |