Deep interpretable early warning system for the detection of clinical deterioration
Assessment of physiological instability preceding adverse events on hospital wards has been previously investigated through clinical early warning score systems. Early warning scores are simple to use yet they consider data as independent and identically distributed random variables. Deep learning a...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Institute of Electrical and Electronics Engineers
2019
|
| _version_ | 1826282068057784320 |
|---|---|
| author | Shamout, F Zhu, T Sharma, P Watkinson, P Clifton, D |
| author_facet | Shamout, F Zhu, T Sharma, P Watkinson, P Clifton, D |
| author_sort | Shamout, F |
| collection | OXFORD |
| description | Assessment of physiological instability preceding adverse events on hospital wards has been previously investigated through clinical early warning score systems. Early warning scores are simple to use yet they consider data as independent and identically distributed random variables. Deep learning applications are able to learn from sequential data, however they lack interpretability and are thus difficult to deploy in clinical settings. We propose the ‘Deep Early Warning System’ (DEWS), an interpretable end-to-end deep learning model that interpolates temporal data and predicts the probability of an adverse event, defined as the composite outcome of cardiac arrest, mortality or unplanned ICU admission. The model was developed and validated using routinely collected vital signs of patients admitted to the the Oxford University Hospitals between 21st March 2014 and 31st March 2018. We extracted 45 314 vital-sign measurements as a balanced training set and 359 481 vital-sign measurements as an imbalanced testing set to mimic a real-life setting of emergency admissions. DEWS achieved superior accuracy than the state-of-the-art that is currently implemented in clinical settings, the National Early Warning Score, in terms of the overall area under the receiver operating characteristic curve (AUROC) (0.880 vs. 0.866) and when evaluated independently for each of the three outcomes. Our attention-based architecture was able to recognize ‘historical’ trends in the data that are most correlated with the predicted probability. With high sensitivity, improved clinical utility and increased interpretability, our model can be easily deployed in clinical settings to supplement existing EWS systems.
|
| first_indexed | 2024-03-07T00:38:16Z |
| format | Journal article |
| id | oxford-uuid:8227b8ed-4aef-4cbd-94ee-0092ad1993a6 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T00:38:16Z |
| publishDate | 2019 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | oxford-uuid:8227b8ed-4aef-4cbd-94ee-0092ad1993a62022-03-26T21:35:27ZDeep interpretable early warning system for the detection of clinical deteriorationJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:8227b8ed-4aef-4cbd-94ee-0092ad1993a6EnglishSymplectic Elements at OxfordInstitute of Electrical and Electronics Engineers2019Shamout, FZhu, TSharma, PWatkinson, PClifton, DAssessment of physiological instability preceding adverse events on hospital wards has been previously investigated through clinical early warning score systems. Early warning scores are simple to use yet they consider data as independent and identically distributed random variables. Deep learning applications are able to learn from sequential data, however they lack interpretability and are thus difficult to deploy in clinical settings. We propose the ‘Deep Early Warning System’ (DEWS), an interpretable end-to-end deep learning model that interpolates temporal data and predicts the probability of an adverse event, defined as the composite outcome of cardiac arrest, mortality or unplanned ICU admission. The model was developed and validated using routinely collected vital signs of patients admitted to the the Oxford University Hospitals between 21st March 2014 and 31st March 2018. We extracted 45 314 vital-sign measurements as a balanced training set and 359 481 vital-sign measurements as an imbalanced testing set to mimic a real-life setting of emergency admissions. DEWS achieved superior accuracy than the state-of-the-art that is currently implemented in clinical settings, the National Early Warning Score, in terms of the overall area under the receiver operating characteristic curve (AUROC) (0.880 vs. 0.866) and when evaluated independently for each of the three outcomes. Our attention-based architecture was able to recognize ‘historical’ trends in the data that are most correlated with the predicted probability. With high sensitivity, improved clinical utility and increased interpretability, our model can be easily deployed in clinical settings to supplement existing EWS systems. |
| spellingShingle | Shamout, F Zhu, T Sharma, P Watkinson, P Clifton, D Deep interpretable early warning system for the detection of clinical deterioration |
| title | Deep interpretable early warning system for the detection of clinical deterioration |
| title_full | Deep interpretable early warning system for the detection of clinical deterioration |
| title_fullStr | Deep interpretable early warning system for the detection of clinical deterioration |
| title_full_unstemmed | Deep interpretable early warning system for the detection of clinical deterioration |
| title_short | Deep interpretable early warning system for the detection of clinical deterioration |
| title_sort | deep interpretable early warning system for the detection of clinical deterioration |
| work_keys_str_mv | AT shamoutf deepinterpretableearlywarningsystemforthedetectionofclinicaldeterioration AT zhut deepinterpretableearlywarningsystemforthedetectionofclinicaldeterioration AT sharmap deepinterpretableearlywarningsystemforthedetectionofclinicaldeterioration AT watkinsonp deepinterpretableearlywarningsystemforthedetectionofclinicaldeterioration AT cliftond deepinterpretableearlywarningsystemforthedetectionofclinicaldeterioration |