Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial

Abstract BackgroundThe 3-Minute Diagnostic Interview for Confusion Assessment Method–Defined Delirium (3D-CAM) is an instrument specially developed for the assessment of delirium in general wards, with high reported sensitivity and specificity. However, the use of the 3D-CAM b...

Full description

Bibliographic Details
Main Authors: Jiamin Wang, Meihua Ji, Yuan Han, Ying Wu
Format: Article
Language:English
Published: JMIR Publications 2024-01-01
Series:JMIR Aging
Online Access:https://aging.jmir.org/2024/1/e51264
_version_ 1797320822569828352
author Jiamin Wang
Meihua Ji
Yuan Han
Ying Wu
author_facet Jiamin Wang
Meihua Ji
Yuan Han
Ying Wu
author_sort Jiamin Wang
collection DOAJ
description Abstract BackgroundThe 3-Minute Diagnostic Interview for Confusion Assessment Method–Defined Delirium (3D-CAM) is an instrument specially developed for the assessment of delirium in general wards, with high reported sensitivity and specificity. However, the use of the 3D-CAM by bedside nurses in routine practice showed relatively poor usability, with multiple human errors during assessment. ObjectiveThis study aimed to develop a mobile app–based delirium assessment tool based on the 3D-CAM and evaluate its usability among older patients by bedside nurses. MethodsThe Delirium Assessment Tool With Decision Support Based on the 3D-CAM (3D-DST) was developed to address existing issues of the 3D-CAM and optimize the assessment process. Following a randomized crossover design, questionnaires were used to evaluate the usability of the 3D-DST among older adults by bedside nurses. Meanwhile, the performances of both the 3D-DST and the 3D-CAM paper version, including the assessment completion rate, time required for completing the assessment, and the number of human errors made by nurses during assessment, were recorded, and their differences were compared. ResultsThe 3D-DST included 3 assessment modules, 9 evaluation interfaces, and 16 results interfaces, with built-in reminders to guide nurses in completing the delirium assessment. In the usability testing, a total of 432 delirium assessments (216 pairs) on 148 older adults were performed by 72 bedside nurses with the 3D-CAM paper version and the 3D-DST. Compared to the 3D-CAM paper version, the mean usability score was significantly higher when using the 3D-DST (4.35 vs 3.40; PPP ConclusionsThis study demonstrated that the 3D-DST significantly improved the efficiency of delirium assessment and was considered highly acceptable by bedside nurses.
first_indexed 2024-03-08T04:48:34Z
format Article
id doaj.art-4c957c02eef74cb985c4455d3b1c4268
institution Directory Open Access Journal
issn 2561-7605
language English
last_indexed 2024-03-08T04:48:34Z
publishDate 2024-01-01
publisher JMIR Publications
record_format Article
series JMIR Aging
spelling doaj.art-4c957c02eef74cb985c4455d3b1c42682024-02-08T07:14:45ZengJMIR PublicationsJMIR Aging2561-76052024-01-017e51264e5126410.2196/51264Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover TrialJiamin Wanghttp://orcid.org/0000-0003-0228-1849Meihua Jihttp://orcid.org/0000-0002-9421-6077Yuan Hanhttp://orcid.org/0009-0003-1228-9833Ying Wuhttp://orcid.org/0000-0002-8633-5404 Abstract BackgroundThe 3-Minute Diagnostic Interview for Confusion Assessment Method–Defined Delirium (3D-CAM) is an instrument specially developed for the assessment of delirium in general wards, with high reported sensitivity and specificity. However, the use of the 3D-CAM by bedside nurses in routine practice showed relatively poor usability, with multiple human errors during assessment. ObjectiveThis study aimed to develop a mobile app–based delirium assessment tool based on the 3D-CAM and evaluate its usability among older patients by bedside nurses. MethodsThe Delirium Assessment Tool With Decision Support Based on the 3D-CAM (3D-DST) was developed to address existing issues of the 3D-CAM and optimize the assessment process. Following a randomized crossover design, questionnaires were used to evaluate the usability of the 3D-DST among older adults by bedside nurses. Meanwhile, the performances of both the 3D-DST and the 3D-CAM paper version, including the assessment completion rate, time required for completing the assessment, and the number of human errors made by nurses during assessment, were recorded, and their differences were compared. ResultsThe 3D-DST included 3 assessment modules, 9 evaluation interfaces, and 16 results interfaces, with built-in reminders to guide nurses in completing the delirium assessment. In the usability testing, a total of 432 delirium assessments (216 pairs) on 148 older adults were performed by 72 bedside nurses with the 3D-CAM paper version and the 3D-DST. Compared to the 3D-CAM paper version, the mean usability score was significantly higher when using the 3D-DST (4.35 vs 3.40; PPP ConclusionsThis study demonstrated that the 3D-DST significantly improved the efficiency of delirium assessment and was considered highly acceptable by bedside nurses.https://aging.jmir.org/2024/1/e51264
spellingShingle Jiamin Wang
Meihua Ji
Yuan Han
Ying Wu
Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial
JMIR Aging
title Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial
title_full Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial
title_fullStr Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial
title_full_unstemmed Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial
title_short Development and Usability Testing of a Mobile App–Based Clinical Decision Support System for Delirium: Randomized Crossover Trial
title_sort development and usability testing of a mobile app based clinical decision support system for delirium randomized crossover trial
url https://aging.jmir.org/2024/1/e51264
work_keys_str_mv AT jiaminwang developmentandusabilitytestingofamobileappbasedclinicaldecisionsupportsystemfordeliriumrandomizedcrossovertrial
AT meihuaji developmentandusabilitytestingofamobileappbasedclinicaldecisionsupportsystemfordeliriumrandomizedcrossovertrial
AT yuanhan developmentandusabilitytestingofamobileappbasedclinicaldecisionsupportsystemfordeliriumrandomizedcrossovertrial
AT yingwu developmentandusabilitytestingofamobileappbasedclinicaldecisionsupportsystemfordeliriumrandomizedcrossovertrial