Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study
Purpose: Artificial intelligence (AI) employs knowledge models that often behave as a black-box to the majority of users and are not designed to improve the skill level of users. In this study, we aim to demonstrate the feasibility that AI can serve as an effective teaching aid to train individuals...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2020-08-01
|
| Series: | Frontiers in Artificial Intelligence |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/frai.2020.00066/full |
| _version_ | 1818176237806288896 |
|---|---|
| author | Matt Mistro Matt Mistro Yang Sheng Yaorong Ge Chris R. Kelsey Jatinder R. Palta Jing Cai Qiuwen Wu Fang-Fang Yin Q. Jackie Wu |
| author_facet | Matt Mistro Matt Mistro Yang Sheng Yaorong Ge Chris R. Kelsey Jatinder R. Palta Jing Cai Qiuwen Wu Fang-Fang Yin Q. Jackie Wu |
| author_sort | Matt Mistro |
| collection | DOAJ |
| description | Purpose: Artificial intelligence (AI) employs knowledge models that often behave as a black-box to the majority of users and are not designed to improve the skill level of users. In this study, we aim to demonstrate the feasibility that AI can serve as an effective teaching aid to train individuals to develop optimal intensity modulated radiation therapy (IMRT) plans.Methods and Materials: The training program is composed of a host of training cases and a tutoring system that consists of a front-end visualization module powered by knowledge models and a scoring system. The current tutoring system includes a beam angle prediction model and a dose-volume histogram (DVH) prediction model. The scoring system consists of physician chosen criteria for clinical plan evaluation as well as specially designed criteria for learning guidance. The training program includes six lung/mediastinum IMRT patients: one benchmark case and five training cases. A plan for the benchmark case is completed by each trainee entirely independently pre- and post-training. Five training cases cover a wide spectrum of complexity from easy (2), intermediate (1) to hard (2). Five trainees completed the training program with the help of one trainer. Plans designed by the trainees were evaluated by both the scoring system and a radiation oncologist to quantify planning quality.Results: For the benchmark case, trainees scored an average of 21.6% of the total max points pre-training and improved to an average of 51.8% post-training. In comparison, the benchmark case's clinical plans score an average of 54.1% of the total max points. Two of the five trainees' post-training plans on the benchmark case were rated as comparable to the clinically delivered plans by the physician and all five were noticeably improved by the physician's standards. The total training time for each trainee ranged between 9 and 12 h.Conclusion: This first attempt at a knowledge model based training program brought unexperienced planners to a level close to experienced planners in fewer than 2 days. The proposed tutoring system can serve as an important component in an AI ecosystem that will enable clinical practitioners to effectively and confidently use KBP. |
| first_indexed | 2024-12-11T20:13:00Z |
| format | Article |
| id | doaj.art-bd5d3e34c4894a06a4942019d8c2d771 |
| institution | Directory Open Access Journal |
| issn | 2624-8212 |
| language | English |
| last_indexed | 2024-12-11T20:13:00Z |
| publishDate | 2020-08-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Artificial Intelligence |
| spelling | doaj.art-bd5d3e34c4894a06a4942019d8c2d7712022-12-22T00:52:15ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122020-08-01310.3389/frai.2020.00066555491Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case StudyMatt Mistro0Matt Mistro1Yang Sheng2Yaorong Ge3Chris R. Kelsey4Jatinder R. Palta5Jing Cai6Qiuwen Wu7Fang-Fang Yin8Q. Jackie Wu9Department of Radiation Oncology, Duke University Medical Center, Durham, NC, United StatesMedical Physics Graduate Program, Duke University, Durham, NC, United StatesDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, United StatesDepartment of Software and Information Systems, University of North Carolina at Charlotte, Charlotte, NC, United StatesDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, United StatesDepartment of Radiation Oncology, Virginia Commonwealth University, Richmond, VA, United StatesDepartment of Health Technology and Informatics, Hong Kong Polytechnic University, Hong Kong, ChinaDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, United StatesDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, United StatesDepartment of Radiation Oncology, Duke University Medical Center, Durham, NC, United StatesPurpose: Artificial intelligence (AI) employs knowledge models that often behave as a black-box to the majority of users and are not designed to improve the skill level of users. In this study, we aim to demonstrate the feasibility that AI can serve as an effective teaching aid to train individuals to develop optimal intensity modulated radiation therapy (IMRT) plans.Methods and Materials: The training program is composed of a host of training cases and a tutoring system that consists of a front-end visualization module powered by knowledge models and a scoring system. The current tutoring system includes a beam angle prediction model and a dose-volume histogram (DVH) prediction model. The scoring system consists of physician chosen criteria for clinical plan evaluation as well as specially designed criteria for learning guidance. The training program includes six lung/mediastinum IMRT patients: one benchmark case and five training cases. A plan for the benchmark case is completed by each trainee entirely independently pre- and post-training. Five training cases cover a wide spectrum of complexity from easy (2), intermediate (1) to hard (2). Five trainees completed the training program with the help of one trainer. Plans designed by the trainees were evaluated by both the scoring system and a radiation oncologist to quantify planning quality.Results: For the benchmark case, trainees scored an average of 21.6% of the total max points pre-training and improved to an average of 51.8% post-training. In comparison, the benchmark case's clinical plans score an average of 54.1% of the total max points. Two of the five trainees' post-training plans on the benchmark case were rated as comparable to the clinically delivered plans by the physician and all five were noticeably improved by the physician's standards. The total training time for each trainee ranged between 9 and 12 h.Conclusion: This first attempt at a knowledge model based training program brought unexperienced planners to a level close to experienced planners in fewer than 2 days. The proposed tutoring system can serve as an important component in an AI ecosystem that will enable clinical practitioners to effectively and confidently use KBP.https://www.frontiersin.org/article/10.3389/frai.2020.00066/fullknowledge modellung cancermachine learningtutoring systemintensity modulated radiation therapy |
| spellingShingle | Matt Mistro Matt Mistro Yang Sheng Yaorong Ge Chris R. Kelsey Jatinder R. Palta Jing Cai Qiuwen Wu Fang-Fang Yin Q. Jackie Wu Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study Frontiers in Artificial Intelligence knowledge model lung cancer machine learning tutoring system intensity modulated radiation therapy |
| title | Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study |
| title_full | Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study |
| title_fullStr | Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study |
| title_full_unstemmed | Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study |
| title_short | Knowledge Models as Teaching Aid for Training Intensity Modulated Radiation Therapy Planning: A Lung Cancer Case Study |
| title_sort | knowledge models as teaching aid for training intensity modulated radiation therapy planning a lung cancer case study |
| topic | knowledge model lung cancer machine learning tutoring system intensity modulated radiation therapy |
| url | https://www.frontiersin.org/article/10.3389/frai.2020.00066/full |
| work_keys_str_mv | AT mattmistro knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT mattmistro knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT yangsheng knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT yaorongge knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT chrisrkelsey knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT jatinderrpalta knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT jingcai knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT qiuwenwu knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT fangfangyin knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy AT qjackiewu knowledgemodelsasteachingaidfortrainingintensitymodulatedradiationtherapyplanningalungcancercasestudy |