A framework to characterize the performance of early warning index alarm systems for patient monitoring

In [Scully, C.G., and Daluwatte, C., Evaluating performance of early warning indices to predict physiological instabilities. J Biomed Inform. 75 (2017) 14–21], a framework was presented to characterize the performance of warning indices to provide information on the 1) probability a critical health...

Full description

Bibliographic Details
Main Authors: Chathuri Daluwatte, Farid Yaghouby, Christopher Scully
Format: Article
Language:English
Published: Elsevier 2019-01-01
Series:MethodsX
Online Access:http://www.sciencedirect.com/science/article/pii/S2215016119301785
_version_ 1818558943219154944
author Chathuri Daluwatte
Farid Yaghouby
Christopher Scully
author_facet Chathuri Daluwatte
Farid Yaghouby
Christopher Scully
author_sort Chathuri Daluwatte
collection DOAJ
description In [Scully, C.G., and Daluwatte, C., Evaluating performance of early warning indices to predict physiological instabilities. J Biomed Inform. 75 (2017) 14–21], a framework was presented to characterize the performance of warning indices to provide information on the 1) probability a critical health event will occur when a warning is given (analogous to positive predictive value) and 2) proportion of warned events to all events (analogous to sensitivity). This framework also provides information about the timeliness of the warnings with respect to event occurrence and the warning burden of the system. • In the current work, we provide information on how this framework can be used when cases without events are present in a dataset to examine the proportion of warned non-events to all non-events (analogous to false positive rate). • Information on steps to apply the method, software, data and results for the case study are also provided to enable implementation of the framework. • Application and extension of the framework is demonstrated and discussed by adding non-event records to our previous case study comparing two warning strategies to predict physiologic instabilities. Method name: A framework to characterize the performance of early warning index alarm systems for patient monitoring, Keywords: Patient monitoring, Warning index, Alarm systems, Performance assessment
first_indexed 2024-12-14T00:18:53Z
format Article
id doaj.art-cab297b68ca64573a0057bdbac8bb161
institution Directory Open Access Journal
issn 2215-0161
language English
last_indexed 2024-12-14T00:18:53Z
publishDate 2019-01-01
publisher Elsevier
record_format Article
series MethodsX
spelling doaj.art-cab297b68ca64573a0057bdbac8bb1612022-12-21T23:25:20ZengElsevierMethodsX2215-01612019-01-01616601667A framework to characterize the performance of early warning index alarm systems for patient monitoringChathuri Daluwatte0Farid Yaghouby1Christopher Scully2Division of Applied Regulatory Science, Office of Clinical Pharmacology, Center for Drug Evaluation and Research, U.S. Food and Drug Administration, United States; Corresponding author.Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, United StatesOffice of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, United StatesIn [Scully, C.G., and Daluwatte, C., Evaluating performance of early warning indices to predict physiological instabilities. J Biomed Inform. 75 (2017) 14–21], a framework was presented to characterize the performance of warning indices to provide information on the 1) probability a critical health event will occur when a warning is given (analogous to positive predictive value) and 2) proportion of warned events to all events (analogous to sensitivity). This framework also provides information about the timeliness of the warnings with respect to event occurrence and the warning burden of the system. • In the current work, we provide information on how this framework can be used when cases without events are present in a dataset to examine the proportion of warned non-events to all non-events (analogous to false positive rate). • Information on steps to apply the method, software, data and results for the case study are also provided to enable implementation of the framework. • Application and extension of the framework is demonstrated and discussed by adding non-event records to our previous case study comparing two warning strategies to predict physiologic instabilities. Method name: A framework to characterize the performance of early warning index alarm systems for patient monitoring, Keywords: Patient monitoring, Warning index, Alarm systems, Performance assessmenthttp://www.sciencedirect.com/science/article/pii/S2215016119301785
spellingShingle Chathuri Daluwatte
Farid Yaghouby
Christopher Scully
A framework to characterize the performance of early warning index alarm systems for patient monitoring
MethodsX
title A framework to characterize the performance of early warning index alarm systems for patient monitoring
title_full A framework to characterize the performance of early warning index alarm systems for patient monitoring
title_fullStr A framework to characterize the performance of early warning index alarm systems for patient monitoring
title_full_unstemmed A framework to characterize the performance of early warning index alarm systems for patient monitoring
title_short A framework to characterize the performance of early warning index alarm systems for patient monitoring
title_sort framework to characterize the performance of early warning index alarm systems for patient monitoring
url http://www.sciencedirect.com/science/article/pii/S2215016119301785
work_keys_str_mv AT chathuridaluwatte aframeworktocharacterizetheperformanceofearlywarningindexalarmsystemsforpatientmonitoring
AT faridyaghouby aframeworktocharacterizetheperformanceofearlywarningindexalarmsystemsforpatientmonitoring
AT christopherscully aframeworktocharacterizetheperformanceofearlywarningindexalarmsystemsforpatientmonitoring
AT chathuridaluwatte frameworktocharacterizetheperformanceofearlywarningindexalarmsystemsforpatientmonitoring
AT faridyaghouby frameworktocharacterizetheperformanceofearlywarningindexalarmsystemsforpatientmonitoring
AT christopherscully frameworktocharacterizetheperformanceofearlywarningindexalarmsystemsforpatientmonitoring