Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care
Importance: Inpatient overcrowding is associated with delays in care, including the deferral of surgical care until beds are available to accommodate postoperative patients. Timely patient discharge is critical to address inpatient overcrowding and requires coordination among surgeons, nurses, case...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
American Medical Association (AMA)
2020
|
| Online Access: | https://hdl.handle.net/1721.1/125713 |
| _version_ | 1811096134319341568 |
|---|---|
| author | Khaniyev, Taghi Zanger, Jonathan Levi, Retsef |
| author2 | Sloan School of Management |
| author_facet | Sloan School of Management Khaniyev, Taghi Zanger, Jonathan Levi, Retsef |
| author_sort | Khaniyev, Taghi |
| collection | MIT |
| description | Importance: Inpatient overcrowding is associated with delays in care, including the deferral of surgical care until beds are available to accommodate postoperative patients. Timely patient discharge is critical to address inpatient overcrowding and requires coordination among surgeons, nurses, case managers, and others. This is difficult to achieve without early identification and systemwide transparency of discharge candidates and their respective barriers to discharge. Objective: To validate the performance of a clinically interpretable feedforward neural network model that could improve the discharge process by predicting which patients would be discharged within 24 hours and their clinical and nonclinical barriers. Design, Setting, and Participants: This prognostic study included adult patients discharged from inpatient surgical care from May 1, 2016, to August 31, 2017, at a quaternary care teaching hospital. Model performance was assessed with standard cross-validation techniques. The model's performance was compared with a baseline model using historical procedure median length of stay to predict discharges. In prospective cohort analysis, the feedforward neural network model was used to make predictions on general surgical care floors with 63 beds. If patients were not discharged when predicted, the causes of delay were recorded. Main Outcomes and Measures: The primary outcome was the out-of-sample area under the receiver operating characteristic curve of the model. Secondary outcomes included the causes of discharge delay and the number of avoidable bed-days. Results: The model was trained on 15 201 patients (median [interquartile range] age, 60 [46-70] years; 7623 [50.1%] men) discharged from inpatient surgical care. The estimated out-of-sample area under the receiver operating characteristic curve of the model was 0.840 (SD, 0.008; 95% CI, 0.839-0.844). Compared with the baseline model, the neural network model had higher sensitivity (52.5% vs 56.6%) and specificity (51.7% vs 82.6%). The neural network model identified 65 barriers to discharge. In the prospective study of 605 patients, causes of delays included clinical barriers (41 patients [30.1%]), variation in clinical practice (30 patients [22.1%]), and nonclinical reasons (65 patients [47.8%]). Summing patients who were not discharged owing to variation in clinical practice and nonclinical reasons, 128 bed-days, or 1.2 beds per day, were classified as avoidable. Conclusions and Relevance: This cohort study found that a neural network model could predict daily inpatient surgical care discharges and their barriers. The model identified systemic causes of discharge delays. Such models should be studied for their ability to increase the timeliness of discharges. |
| first_indexed | 2024-09-23T16:38:42Z |
| format | Article |
| id | mit-1721.1/125713 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T16:38:42Z |
| publishDate | 2020 |
| publisher | American Medical Association (AMA) |
| record_format | dspace |
| spelling | mit-1721.1/1257132022-09-29T20:32:17Z Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care Khaniyev, Taghi Zanger, Jonathan Levi, Retsef Sloan School of Management Importance: Inpatient overcrowding is associated with delays in care, including the deferral of surgical care until beds are available to accommodate postoperative patients. Timely patient discharge is critical to address inpatient overcrowding and requires coordination among surgeons, nurses, case managers, and others. This is difficult to achieve without early identification and systemwide transparency of discharge candidates and their respective barriers to discharge. Objective: To validate the performance of a clinically interpretable feedforward neural network model that could improve the discharge process by predicting which patients would be discharged within 24 hours and their clinical and nonclinical barriers. Design, Setting, and Participants: This prognostic study included adult patients discharged from inpatient surgical care from May 1, 2016, to August 31, 2017, at a quaternary care teaching hospital. Model performance was assessed with standard cross-validation techniques. The model's performance was compared with a baseline model using historical procedure median length of stay to predict discharges. In prospective cohort analysis, the feedforward neural network model was used to make predictions on general surgical care floors with 63 beds. If patients were not discharged when predicted, the causes of delay were recorded. Main Outcomes and Measures: The primary outcome was the out-of-sample area under the receiver operating characteristic curve of the model. Secondary outcomes included the causes of discharge delay and the number of avoidable bed-days. Results: The model was trained on 15 201 patients (median [interquartile range] age, 60 [46-70] years; 7623 [50.1%] men) discharged from inpatient surgical care. The estimated out-of-sample area under the receiver operating characteristic curve of the model was 0.840 (SD, 0.008; 95% CI, 0.839-0.844). Compared with the baseline model, the neural network model had higher sensitivity (52.5% vs 56.6%) and specificity (51.7% vs 82.6%). The neural network model identified 65 barriers to discharge. In the prospective study of 605 patients, causes of delays included clinical barriers (41 patients [30.1%]), variation in clinical practice (30 patients [22.1%]), and nonclinical reasons (65 patients [47.8%]). Summing patients who were not discharged owing to variation in clinical practice and nonclinical reasons, 128 bed-days, or 1.2 beds per day, were classified as avoidable. Conclusions and Relevance: This cohort study found that a neural network model could predict daily inpatient surgical care discharges and their barriers. The model identified systemic causes of discharge delays. Such models should be studied for their ability to increase the timeliness of discharges. 2020-06-08T16:33:02Z 2020-06-08T16:33:02Z 2019-12 2020-03-30T14:39:32Z Article http://purl.org/eprint/type/JournalArticle 2574-3805 https://hdl.handle.net/1721.1/125713 Safav, Kyan C. et al. “Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care” JAMA network open, vol. 2, no. 12, 2019, e1917221 © 2019 The Author(s) en https://dx.doi.org/10.1001/jamanetworkopen.2019.17221 JAMA network open Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf American Medical Association (AMA) JAMA Network Open |
| spellingShingle | Khaniyev, Taghi Zanger, Jonathan Levi, Retsef Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care |
| title | Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care |
| title_full | Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care |
| title_fullStr | Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care |
| title_full_unstemmed | Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care |
| title_short | Development and Validation of a Machine Learning Model to Aid Discharge Processes for Inpatient Surgical Care |
| title_sort | development and validation of a machine learning model to aid discharge processes for inpatient surgical care |
| url | https://hdl.handle.net/1721.1/125713 |
| work_keys_str_mv | AT khaniyevtaghi developmentandvalidationofamachinelearningmodeltoaiddischargeprocessesforinpatientsurgicalcare AT zangerjonathan developmentandvalidationofamachinelearningmodeltoaiddischargeprocessesforinpatientsurgicalcare AT leviretsef developmentandvalidationofamachinelearningmodeltoaiddischargeprocessesforinpatientsurgicalcare |