Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review

Abstract Background There is a growing number of randomized controlled trials (RCTs) evaluating interventions to prevent or treat delirium in the intensive care unit (ICU). Efforts to improve the conduct of delirium RCTs are underway, but none address issues related to statistical analysis. The purp...

Full description

Bibliographic Details
Main Authors: Elizabeth Colantuoni, Mounica Koneru, Narjes Akhlaghi, Ximin Li, Mohamed D. Hashem, Victor D. Dinglas, Karin J. Neufeld, Michael O. Harhay, Dale M. Needham
Format: Article
Language:English
Published: BMC 2021-05-01
Series:Trials
Subjects:
Online Access:https://doi.org/10.1186/s13063-021-05299-1
_version_ 1819101287112769536
author Elizabeth Colantuoni
Mounica Koneru
Narjes Akhlaghi
Ximin Li
Mohamed D. Hashem
Victor D. Dinglas
Karin J. Neufeld
Michael O. Harhay
Dale M. Needham
author_facet Elizabeth Colantuoni
Mounica Koneru
Narjes Akhlaghi
Ximin Li
Mohamed D. Hashem
Victor D. Dinglas
Karin J. Neufeld
Michael O. Harhay
Dale M. Needham
author_sort Elizabeth Colantuoni
collection DOAJ
description Abstract Background There is a growing number of randomized controlled trials (RCTs) evaluating interventions to prevent or treat delirium in the intensive care unit (ICU). Efforts to improve the conduct of delirium RCTs are underway, but none address issues related to statistical analysis. The purpose of this review is to evaluate heterogeneity in the design and analysis of delirium outcomes and advance methodological recommendations for delirium RCTs in the ICU. Methods Relevant databases, including PubMed and Embase, were searched with no restrictions on language or publication date; the search was conducted on July 8, 2019. RCTs conducted on adult ICU patients with delirium as the primary outcome were included where trial results were available. Data on frequency and duration of delirium assessments, delirium outcome definitions, and statistical methods were independently extracted in duplicate. The review was registered with PROSPERO (CRD42020141204). Results Among 65 eligible RCTs, 44 (68%) targeted the prevention of delirium. The duration of follow-up varied, with 31 (48%) RCTs having ≤7 days of follow-up, and only 24 (37%) conducting delirium assessments after ICU discharge. The incidence of delirium was the most common outcome (50 RCTs, 77%) for which 8 unique statistical methods were applied. The most common method, applied to 51 of 56 (91%) delirium incidence outcomes, was the two-sample test comparing the proportion of patients who ever experienced delirium. In the presence of censoring of patients at ICU discharge or death, this test may be misleading. The impact of censoring was also not considered in most analyses of the duration of delirium, as evaluated in 24 RCTs, with 21 (88%) delirium duration outcomes analyzed using a non-parametric test or two-sample t test. Composite outcomes (e.g., rank-based delirium- and coma-free days), used in 11 (17%) RCTs, seldom explicitly defined how ICU discharge, and death were incorporated into the definition and were analyzed using non-parametric tests (11 of 13 (85%) composite outcomes). Conclusions To improve delirium RCTs, outcomes should be explicitly defined. To account for censoring due to ICU discharge or death, survival analysis methods should be considered for delirium incidence and duration outcomes; non-parametric tests are recommended for rank-based delirium composite outcomes. Trial registration PROSPERO CRD42020141204 . Registration date: 7/3/2019.
first_indexed 2024-12-22T01:16:16Z
format Article
id doaj.art-eb590fe231614c0fb8bb5a160b0d824c
institution Directory Open Access Journal
issn 1745-6215
language English
last_indexed 2024-12-22T01:16:16Z
publishDate 2021-05-01
publisher BMC
record_format Article
series Trials
spelling doaj.art-eb590fe231614c0fb8bb5a160b0d824c2022-12-21T18:43:52ZengBMCTrials1745-62152021-05-0122111210.1186/s13063-021-05299-1Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic reviewElizabeth Colantuoni0Mounica Koneru1Narjes Akhlaghi2Ximin Li3Mohamed D. Hashem4Victor D. Dinglas5Karin J. Neufeld6Michael O. Harhay7Dale M. Needham8Department of Biostatistics, Bloomberg School of Public Health, Johns Hopkins UniversityOutcomes After Critical Illness and Surgery, Johns Hopkins School of MedicineOutcomes After Critical Illness and Surgery, Johns Hopkins School of MedicineDepartment of Biostatistics, Bloomberg School of Public Health, Johns Hopkins UniversityDepartment of Medicine, Marshfield ClinicOutcomes After Critical Illness and Surgery, Johns Hopkins School of MedicineOutcomes After Critical Illness and Surgery, Johns Hopkins School of MedicineDepartment of Epidemiology, Perelman School of Medicine, University of PennsylvaniaOutcomes After Critical Illness and Surgery, Johns Hopkins School of MedicineAbstract Background There is a growing number of randomized controlled trials (RCTs) evaluating interventions to prevent or treat delirium in the intensive care unit (ICU). Efforts to improve the conduct of delirium RCTs are underway, but none address issues related to statistical analysis. The purpose of this review is to evaluate heterogeneity in the design and analysis of delirium outcomes and advance methodological recommendations for delirium RCTs in the ICU. Methods Relevant databases, including PubMed and Embase, were searched with no restrictions on language or publication date; the search was conducted on July 8, 2019. RCTs conducted on adult ICU patients with delirium as the primary outcome were included where trial results were available. Data on frequency and duration of delirium assessments, delirium outcome definitions, and statistical methods were independently extracted in duplicate. The review was registered with PROSPERO (CRD42020141204). Results Among 65 eligible RCTs, 44 (68%) targeted the prevention of delirium. The duration of follow-up varied, with 31 (48%) RCTs having ≤7 days of follow-up, and only 24 (37%) conducting delirium assessments after ICU discharge. The incidence of delirium was the most common outcome (50 RCTs, 77%) for which 8 unique statistical methods were applied. The most common method, applied to 51 of 56 (91%) delirium incidence outcomes, was the two-sample test comparing the proportion of patients who ever experienced delirium. In the presence of censoring of patients at ICU discharge or death, this test may be misleading. The impact of censoring was also not considered in most analyses of the duration of delirium, as evaluated in 24 RCTs, with 21 (88%) delirium duration outcomes analyzed using a non-parametric test or two-sample t test. Composite outcomes (e.g., rank-based delirium- and coma-free days), used in 11 (17%) RCTs, seldom explicitly defined how ICU discharge, and death were incorporated into the definition and were analyzed using non-parametric tests (11 of 13 (85%) composite outcomes). Conclusions To improve delirium RCTs, outcomes should be explicitly defined. To account for censoring due to ICU discharge or death, survival analysis methods should be considered for delirium incidence and duration outcomes; non-parametric tests are recommended for rank-based delirium composite outcomes. Trial registration PROSPERO CRD42020141204 . Registration date: 7/3/2019.https://doi.org/10.1186/s13063-021-05299-1Systematic reviewRandomized trialsCritically ill patientsDeliriumOutcome definitionStatistical methods
spellingShingle Elizabeth Colantuoni
Mounica Koneru
Narjes Akhlaghi
Ximin Li
Mohamed D. Hashem
Victor D. Dinglas
Karin J. Neufeld
Michael O. Harhay
Dale M. Needham
Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review
Trials
Systematic review
Randomized trials
Critically ill patients
Delirium
Outcome definition
Statistical methods
title Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review
title_full Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review
title_fullStr Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review
title_full_unstemmed Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review
title_short Heterogeneity in design and analysis of ICU delirium randomized trials: a systematic review
title_sort heterogeneity in design and analysis of icu delirium randomized trials a systematic review
topic Systematic review
Randomized trials
Critically ill patients
Delirium
Outcome definition
Statistical methods
url https://doi.org/10.1186/s13063-021-05299-1
work_keys_str_mv AT elizabethcolantuoni heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT mounicakoneru heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT narjesakhlaghi heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT ximinli heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT mohameddhashem heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT victorddinglas heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT karinjneufeld heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT michaeloharhay heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview
AT dalemneedham heterogeneityindesignandanalysisoficudeliriumrandomizedtrialsasystematicreview