Development and usability testing of a patient digital twin for critical care education: a mixed methods study
BackgroundDigital twins are computerized patient replicas that allow clinical interventions testing in silico to minimize preventable patient harm. Our group has developed a novel application software utilizing a digital twin patient model based on electronic health record (EHR) variables to simulat...
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-01-01
|
| Series: | Frontiers in Medicine |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fmed.2023.1336897/full |
| _version_ | 1797357784908431360 |
|---|---|
| author | Lucrezia Rovati Lucrezia Rovati Phillip J. Gary Edin Cubro Yue Dong Oguz Kilickaya Phillip J. Schulte Xiang Zhong Malin Wörster Diana J. Kelm Ognjen Gajic Alexander S. Niven Amos Lal |
| author_facet | Lucrezia Rovati Lucrezia Rovati Phillip J. Gary Edin Cubro Yue Dong Oguz Kilickaya Phillip J. Schulte Xiang Zhong Malin Wörster Diana J. Kelm Ognjen Gajic Alexander S. Niven Amos Lal |
| author_sort | Lucrezia Rovati |
| collection | DOAJ |
| description | BackgroundDigital twins are computerized patient replicas that allow clinical interventions testing in silico to minimize preventable patient harm. Our group has developed a novel application software utilizing a digital twin patient model based on electronic health record (EHR) variables to simulate clinical trajectories during the initial 6 h of critical illness. This study aimed to assess the usability, workload, and acceptance of the digital twin application as an educational tool in critical care.MethodsA mixed methods study was conducted during seven user testing sessions of the digital twin application with thirty-five first-year internal medicine residents. Qualitative data were collected using a think-aloud and semi-structured interview format, while quantitative measurements included the System Usability Scale (SUS), NASA Task Load Index (NASA-TLX), and a short survey.ResultsMedian SUS scores and NASA-TLX were 70 (IQR 62.5–82.5) and 29.2 (IQR 22.5–34.2), consistent with good software usability and low to moderate workload, respectively. Residents expressed interest in using the digital twin application for ICU rotations and identified five themes for software improvement: clinical fidelity, interface organization, learning experience, serious gaming, and implementation strategies.ConclusionA digital twin application based on EHR clinical variables showed good usability and high acceptance for critical care education. |
| first_indexed | 2024-03-08T14:50:14Z |
| format | Article |
| id | doaj.art-84569bffa7b243b894c5d60d1839bce2 |
| institution | Directory Open Access Journal |
| issn | 2296-858X |
| language | English |
| last_indexed | 2024-03-08T14:50:14Z |
| publishDate | 2024-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Medicine |
| spelling | doaj.art-84569bffa7b243b894c5d60d1839bce22024-01-11T04:24:06ZengFrontiers Media S.A.Frontiers in Medicine2296-858X2024-01-011010.3389/fmed.2023.13368971336897Development and usability testing of a patient digital twin for critical care education: a mixed methods studyLucrezia Rovati0Lucrezia Rovati1Phillip J. Gary2Edin Cubro3Yue Dong4Oguz Kilickaya5Phillip J. Schulte6Xiang Zhong7Malin Wörster8Diana J. Kelm9Ognjen Gajic10Alexander S. Niven11Amos Lal12Department of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesSchool of Medicine and Surgery, University of Milano-Bicocca, Milan, ItalyDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesDepartment of Information Technology, Mayo Clinic, Rochester, MN, United StatesDepartment of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN, United StatesDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesDepartment of Quantitative Health Sciences, Division of Clinical Trials and Biostatistics, Mayo Clinic, Rochester, MN, United StatesDepartment of Industrial and Systems Engineering, University of Florida, Gainesville, FL, United StatesCenter for Anesthesiology and Intensive Care Medicine, Department of Anesthesiology, University Medical Center Hamburg-Eppendorf, Hamburg, GermanyDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesDepartment of Medicine, Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, United StatesBackgroundDigital twins are computerized patient replicas that allow clinical interventions testing in silico to minimize preventable patient harm. Our group has developed a novel application software utilizing a digital twin patient model based on electronic health record (EHR) variables to simulate clinical trajectories during the initial 6 h of critical illness. This study aimed to assess the usability, workload, and acceptance of the digital twin application as an educational tool in critical care.MethodsA mixed methods study was conducted during seven user testing sessions of the digital twin application with thirty-five first-year internal medicine residents. Qualitative data were collected using a think-aloud and semi-structured interview format, while quantitative measurements included the System Usability Scale (SUS), NASA Task Load Index (NASA-TLX), and a short survey.ResultsMedian SUS scores and NASA-TLX were 70 (IQR 62.5–82.5) and 29.2 (IQR 22.5–34.2), consistent with good software usability and low to moderate workload, respectively. Residents expressed interest in using the digital twin application for ICU rotations and identified five themes for software improvement: clinical fidelity, interface organization, learning experience, serious gaming, and implementation strategies.ConclusionA digital twin application based on EHR clinical variables showed good usability and high acceptance for critical care education.https://www.frontiersin.org/articles/10.3389/fmed.2023.1336897/fullcritical caremedical educationpatient-specific modelingsimulation trainingpatient safetymedical intensive care unit |
| spellingShingle | Lucrezia Rovati Lucrezia Rovati Phillip J. Gary Edin Cubro Yue Dong Oguz Kilickaya Phillip J. Schulte Xiang Zhong Malin Wörster Diana J. Kelm Ognjen Gajic Alexander S. Niven Amos Lal Development and usability testing of a patient digital twin for critical care education: a mixed methods study Frontiers in Medicine critical care medical education patient-specific modeling simulation training patient safety medical intensive care unit |
| title | Development and usability testing of a patient digital twin for critical care education: a mixed methods study |
| title_full | Development and usability testing of a patient digital twin for critical care education: a mixed methods study |
| title_fullStr | Development and usability testing of a patient digital twin for critical care education: a mixed methods study |
| title_full_unstemmed | Development and usability testing of a patient digital twin for critical care education: a mixed methods study |
| title_short | Development and usability testing of a patient digital twin for critical care education: a mixed methods study |
| title_sort | development and usability testing of a patient digital twin for critical care education a mixed methods study |
| topic | critical care medical education patient-specific modeling simulation training patient safety medical intensive care unit |
| url | https://www.frontiersin.org/articles/10.3389/fmed.2023.1336897/full |
| work_keys_str_mv | AT lucreziarovati developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT lucreziarovati developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT phillipjgary developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT edincubro developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT yuedong developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT oguzkilickaya developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT phillipjschulte developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT xiangzhong developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT malinworster developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT dianajkelm developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT ognjengajic developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT alexandersniven developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy AT amoslal developmentandusabilitytestingofapatientdigitaltwinforcriticalcareeducationamixedmethodsstudy |