A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study
BackgroundAcute kidney injury (AKI) represents a significant global health challenge, leading to increased patient distress and financial health care burdens. The development of AKI in intensive care unit (ICU) settings is linked to prolonged ICU stays, a heightened risk of l...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2023-12-01
|
| Series: | JMIR Formative Research |
| Online Access: | https://formative.jmir.org/2023/1/e45979 |
| _version_ | 1797391297196064768 |
|---|---|
| author | Inger Persson Adam Grünwald Ludivine Morvan David Becedas Martin Arlbrandt |
| author_facet | Inger Persson Adam Grünwald Ludivine Morvan David Becedas Martin Arlbrandt |
| author_sort | Inger Persson |
| collection | DOAJ |
| description |
BackgroundAcute kidney injury (AKI) represents a significant global health challenge, leading to increased patient distress and financial health care burdens. The development of AKI in intensive care unit (ICU) settings is linked to prolonged ICU stays, a heightened risk of long-term renal dysfunction, and elevated short- and long-term mortality rates. The current diagnostic approach for AKI is based on late indicators, such as elevated serum creatinine and decreased urine output, which can only detect AKI after renal injury has transpired. There are no treatments to reverse or restore renal function once AKI has developed, other than supportive care. Early prediction of AKI enables proactive management and may improve patient outcomes.
ObjectiveThe primary aim was to develop a machine learning algorithm, NAVOY Acute Kidney Injury, capable of predicting the onset of AKI in ICU patients using data routinely collected in ICU electronic health records. The ultimate goal was to create a clinical decision support tool that empowers ICU clinicians to proactively manage AKI and, consequently, enhance patient outcomes.
MethodsWe developed the NAVOY Acute Kidney Injury algorithm using a hybrid ensemble model, which combines the strengths of both a Random Forest (Leo Breiman and Adele Cutler) and an XGBoost model (Tianqi Chen). To ensure the accuracy of predictions, the algorithm used 22 clinical variables for hourly predictions of AKI as defined by the Kidney Disease: Improving Global Outcomes guidelines. Data for algorithm development were sourced from the Massachusetts Institute of Technology Lab for Computational Physiology Medical Information Mart for Intensive Care IV clinical database, focusing on ICU patients aged 18 years or older.
ResultsThe developed algorithm, NAVOY Acute Kidney Injury, uses 4 hours of input and can, with high accuracy, predict patients with a high risk of developing AKI 12 hours before onset. The prediction performance compares well with previously published prediction algorithms designed to predict AKI onset in accordance with Kidney Disease: Improving Global Outcomes diagnosis criteria, with an impressive area under the receiver operating characteristics curve (AUROC) of 0.91 and an area under the precision-recall curve (AUPRC) of 0.75. The algorithm’s predictive performance was externally validated on an independent hold-out test data set, confirming its ability to predict AKI with exceptional accuracy.
ConclusionsNAVOY Acute Kidney Injury is an important development in the field of critical care medicine. It offers the ability to predict the onset of AKI with high accuracy using only 4 hours of data routinely collected in ICU electronic health records. This early detection capability has the potential to strengthen patient monitoring and management, ultimately leading to improved patient outcomes. Furthermore, NAVOY Acute Kidney Injury has been granted Conformite Europeenne (CE)–marking, marking a significant milestone as the first CE-marked AKI prediction algorithm for commercial use in European ICUs. |
| first_indexed | 2024-03-08T23:30:50Z |
| format | Article |
| id | doaj.art-8ce306d7375f40769abbc6eb04650e84 |
| institution | Directory Open Access Journal |
| issn | 2561-326X |
| language | English |
| last_indexed | 2024-03-08T23:30:50Z |
| publishDate | 2023-12-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Formative Research |
| spelling | doaj.art-8ce306d7375f40769abbc6eb04650e842023-12-14T13:45:55ZengJMIR PublicationsJMIR Formative Research2561-326X2023-12-017e4597910.2196/45979A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept StudyInger Perssonhttps://orcid.org/0000-0001-6330-5037Adam Grünwaldhttps://orcid.org/0009-0006-0485-7388Ludivine Morvanhttps://orcid.org/0000-0003-1915-6374David Becedashttps://orcid.org/0000-0002-4554-5480Martin Arlbrandthttps://orcid.org/0000-0002-7478-3437 BackgroundAcute kidney injury (AKI) represents a significant global health challenge, leading to increased patient distress and financial health care burdens. The development of AKI in intensive care unit (ICU) settings is linked to prolonged ICU stays, a heightened risk of long-term renal dysfunction, and elevated short- and long-term mortality rates. The current diagnostic approach for AKI is based on late indicators, such as elevated serum creatinine and decreased urine output, which can only detect AKI after renal injury has transpired. There are no treatments to reverse or restore renal function once AKI has developed, other than supportive care. Early prediction of AKI enables proactive management and may improve patient outcomes. ObjectiveThe primary aim was to develop a machine learning algorithm, NAVOY Acute Kidney Injury, capable of predicting the onset of AKI in ICU patients using data routinely collected in ICU electronic health records. The ultimate goal was to create a clinical decision support tool that empowers ICU clinicians to proactively manage AKI and, consequently, enhance patient outcomes. MethodsWe developed the NAVOY Acute Kidney Injury algorithm using a hybrid ensemble model, which combines the strengths of both a Random Forest (Leo Breiman and Adele Cutler) and an XGBoost model (Tianqi Chen). To ensure the accuracy of predictions, the algorithm used 22 clinical variables for hourly predictions of AKI as defined by the Kidney Disease: Improving Global Outcomes guidelines. Data for algorithm development were sourced from the Massachusetts Institute of Technology Lab for Computational Physiology Medical Information Mart for Intensive Care IV clinical database, focusing on ICU patients aged 18 years or older. ResultsThe developed algorithm, NAVOY Acute Kidney Injury, uses 4 hours of input and can, with high accuracy, predict patients with a high risk of developing AKI 12 hours before onset. The prediction performance compares well with previously published prediction algorithms designed to predict AKI onset in accordance with Kidney Disease: Improving Global Outcomes diagnosis criteria, with an impressive area under the receiver operating characteristics curve (AUROC) of 0.91 and an area under the precision-recall curve (AUPRC) of 0.75. The algorithm’s predictive performance was externally validated on an independent hold-out test data set, confirming its ability to predict AKI with exceptional accuracy. ConclusionsNAVOY Acute Kidney Injury is an important development in the field of critical care medicine. It offers the ability to predict the onset of AKI with high accuracy using only 4 hours of data routinely collected in ICU electronic health records. This early detection capability has the potential to strengthen patient monitoring and management, ultimately leading to improved patient outcomes. Furthermore, NAVOY Acute Kidney Injury has been granted Conformite Europeenne (CE)–marking, marking a significant milestone as the first CE-marked AKI prediction algorithm for commercial use in European ICUs.https://formative.jmir.org/2023/1/e45979 |
| spellingShingle | Inger Persson Adam Grünwald Ludivine Morvan David Becedas Martin Arlbrandt A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study JMIR Formative Research |
| title | A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study |
| title_full | A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study |
| title_fullStr | A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study |
| title_full_unstemmed | A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study |
| title_short | A Machine Learning Algorithm Predicting Acute Kidney Injury in Intensive Care Unit Patients (NAVOY Acute Kidney Injury): Proof-of-Concept Study |
| title_sort | machine learning algorithm predicting acute kidney injury in intensive care unit patients navoy acute kidney injury proof of concept study |
| url | https://formative.jmir.org/2023/1/e45979 |
| work_keys_str_mv | AT ingerpersson amachinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT adamgrunwald amachinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT ludivinemorvan amachinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT davidbecedas amachinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT martinarlbrandt amachinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT ingerpersson machinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT adamgrunwald machinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT ludivinemorvan machinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT davidbecedas machinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy AT martinarlbrandt machinelearningalgorithmpredictingacutekidneyinjuryinintensivecareunitpatientsnavoyacutekidneyinjuryproofofconceptstudy |