Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment
BackgroundCare for patients with heart failure (HF) causes a substantial load on health care systems where a prominent challenge is the elevated rate of readmissions within 30 days following initial discharge. Clinical professionals face high levels of uncertainty and subject...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-03-01
|
| Series: | JMIR Research Protocols |
| Online Access: | https://www.researchprotocols.org/2024/1/e52744 |
| _version_ | 1797266019934273536 |
|---|---|
| author | Monika Nair Lina E Lundgren Amira Soliman Petra Dryselius Ebba Fogelberg Marcus Petersson Omar Hamed Miltiadis Triantafyllou Jens Nygren |
| author_facet | Monika Nair Lina E Lundgren Amira Soliman Petra Dryselius Ebba Fogelberg Marcus Petersson Omar Hamed Miltiadis Triantafyllou Jens Nygren |
| author_sort | Monika Nair |
| collection | DOAJ |
| description |
BackgroundCare for patients with heart failure (HF) causes a substantial load on health care systems where a prominent challenge is the elevated rate of readmissions within 30 days following initial discharge. Clinical professionals face high levels of uncertainty and subjectivity in the decision-making process on the optimal timing of discharge. Unwanted hospital stays generate costs and cause stress to patients and potentially have an impact on care outcomes. Recent studies have aimed to mitigate the uncertainty by developing and testing risk assessment tools and predictive models to identify patients at risk of readmission, often using novel methods such as machine learning (ML).
ObjectiveThis study aims to investigate how a developed clinical decision support (CDS) tool alters the decision-making processes of health care professionals in the specific context of discharging patients with HF, and if so, in which ways. Additionally, the aim is to capture the experiences of health care practitioners as they engage with the system’s outputs to analyze usability aspects and obtain insights related to future implementation.
MethodsA quasi-experimental design with randomized crossover assessment will be conducted with health care professionals on HF patients’ scenarios in a region located in the South of Sweden. In total, 12 physicians and nurses will be randomized into control and test groups. The groups shall be provided with 20 scenarios of purposefully sampled patients. The clinicians will be asked to take decisions on the next action regarding a patient. The test group will be provided with the 10 scenarios containing patient data from electronic health records and an outcome from an ML-based CDS model on the risk level for readmission of the same patients. The control group will have 10 other scenarios without the CDS model output and containing only the patients’ data from electronic medical records. The groups will switch roles for the next 10 scenarios. This study will collect data through interviews and observations. The key outcome measures are decision consistency, decision quality, work efficiency, perceived benefits of using the CDS model, reliability, validity, and confidence in the CDS model outcome, integrability in the routine workflow, ease of use, and intention to use. This study will be carried out in collaboration with Cambio Healthcare Systems.
ResultsThe project is part of the Center for Applied Intelligent Systems Research Health research profile, funded by the Knowledge Foundation (2021-2028). Ethical approval for this study was granted by the Swedish ethical review authority (2022-07287-02). The recruitment process of the clinicians and the patient scenario selection will start in September 2023 and last till March 2024.
ConclusionsThis study protocol will contribute to the development of future formative evaluation studies to test ML models with clinical professionals.
International Registered Report Identifier (IRRID)PRR1-10.2196/52744 |
| first_indexed | 2024-04-25T00:54:02Z |
| format | Article |
| id | doaj.art-925acdba1bf14f138f2b203d791cd92e |
| institution | Directory Open Access Journal |
| issn | 1929-0748 |
| language | English |
| last_indexed | 2024-04-25T00:54:02Z |
| publishDate | 2024-03-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Research Protocols |
| spelling | doaj.art-925acdba1bf14f138f2b203d791cd92e2024-03-11T12:45:33ZengJMIR PublicationsJMIR Research Protocols1929-07482024-03-0113e5274410.2196/52744Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact AssessmentMonika Nairhttps://orcid.org/0000-0001-7610-0954Lina E Lundgrenhttps://orcid.org/0000-0002-2513-3040Amira Solimanhttps://orcid.org/0000-0002-0264-8762Petra Dryseliushttps://orcid.org/0009-0006-1345-2710Ebba Fogelberghttps://orcid.org/0009-0008-8286-2435Marcus Peterssonhttps://orcid.org/0009-0001-7530-5138Omar Hamedhttps://orcid.org/0009-0006-2330-2580Miltiadis Triantafyllouhttps://orcid.org/0009-0007-0659-4355Jens Nygrenhttps://orcid.org/0000-0002-3576-2393 BackgroundCare for patients with heart failure (HF) causes a substantial load on health care systems where a prominent challenge is the elevated rate of readmissions within 30 days following initial discharge. Clinical professionals face high levels of uncertainty and subjectivity in the decision-making process on the optimal timing of discharge. Unwanted hospital stays generate costs and cause stress to patients and potentially have an impact on care outcomes. Recent studies have aimed to mitigate the uncertainty by developing and testing risk assessment tools and predictive models to identify patients at risk of readmission, often using novel methods such as machine learning (ML). ObjectiveThis study aims to investigate how a developed clinical decision support (CDS) tool alters the decision-making processes of health care professionals in the specific context of discharging patients with HF, and if so, in which ways. Additionally, the aim is to capture the experiences of health care practitioners as they engage with the system’s outputs to analyze usability aspects and obtain insights related to future implementation. MethodsA quasi-experimental design with randomized crossover assessment will be conducted with health care professionals on HF patients’ scenarios in a region located in the South of Sweden. In total, 12 physicians and nurses will be randomized into control and test groups. The groups shall be provided with 20 scenarios of purposefully sampled patients. The clinicians will be asked to take decisions on the next action regarding a patient. The test group will be provided with the 10 scenarios containing patient data from electronic health records and an outcome from an ML-based CDS model on the risk level for readmission of the same patients. The control group will have 10 other scenarios without the CDS model output and containing only the patients’ data from electronic medical records. The groups will switch roles for the next 10 scenarios. This study will collect data through interviews and observations. The key outcome measures are decision consistency, decision quality, work efficiency, perceived benefits of using the CDS model, reliability, validity, and confidence in the CDS model outcome, integrability in the routine workflow, ease of use, and intention to use. This study will be carried out in collaboration with Cambio Healthcare Systems. ResultsThe project is part of the Center for Applied Intelligent Systems Research Health research profile, funded by the Knowledge Foundation (2021-2028). Ethical approval for this study was granted by the Swedish ethical review authority (2022-07287-02). The recruitment process of the clinicians and the patient scenario selection will start in September 2023 and last till March 2024. ConclusionsThis study protocol will contribute to the development of future formative evaluation studies to test ML models with clinical professionals. International Registered Report Identifier (IRRID)PRR1-10.2196/52744https://www.researchprotocols.org/2024/1/e52744 |
| spellingShingle | Monika Nair Lina E Lundgren Amira Soliman Petra Dryselius Ebba Fogelberg Marcus Petersson Omar Hamed Miltiadis Triantafyllou Jens Nygren Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment JMIR Research Protocols |
| title | Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment |
| title_full | Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment |
| title_fullStr | Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment |
| title_full_unstemmed | Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment |
| title_short | Machine Learning Model for Readmission Prediction of Patients With Heart Failure Based on Electronic Health Records: Protocol for a Quasi-Experimental Study for Impact Assessment |
| title_sort | machine learning model for readmission prediction of patients with heart failure based on electronic health records protocol for a quasi experimental study for impact assessment |
| url | https://www.researchprotocols.org/2024/1/e52744 |
| work_keys_str_mv | AT monikanair machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT linaelundgren machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT amirasoliman machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT petradryselius machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT ebbafogelberg machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT marcuspetersson machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT omarhamed machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT miltiadistriantafyllou machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment AT jensnygren machinelearningmodelforreadmissionpredictionofpatientswithheartfailurebasedonelectronichealthrecordsprotocolforaquasiexperimentalstudyforimpactassessment |