Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials

BackgroundMental health problems are a crucial global public health concern. Owing to their cost-effectiveness and accessibility, conversational agent interventions (CAIs) are promising in the field of mental health care. ObjectiveThis study aims to present a thor...

Full description

Bibliographic Details
Main Authors: Yuhao He, Li Yang, Chunlian Qian, Tong Li, Zhengyuan Su, Qiang Zhang, Xiangqing Hou
Format: Article
Language:English
Published: JMIR Publications 2023-04-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2023/1/e43862
_version_ 1797734108784230400
author Yuhao He
Li Yang
Chunlian Qian
Tong Li
Zhengyuan Su
Qiang Zhang
Xiangqing Hou
author_facet Yuhao He
Li Yang
Chunlian Qian
Tong Li
Zhengyuan Su
Qiang Zhang
Xiangqing Hou
author_sort Yuhao He
collection DOAJ
description BackgroundMental health problems are a crucial global public health concern. Owing to their cost-effectiveness and accessibility, conversational agent interventions (CAIs) are promising in the field of mental health care. ObjectiveThis study aims to present a thorough summary of the traits of CAIs available for a range of mental health problems, find evidence of efficacy, and analyze the statistically significant moderators of efficacy via a meta-analysis of randomized controlled trial. MethodsWeb-based databases (Embase, MEDLINE, PsycINFO, CINAHL, Web of Science, and Cochrane) were systematically searched dated from the establishment of the database to October 30, 2021, and updated to May 1, 2022. Randomized controlled trials comparing CAIs with any other type of control condition in improving depressive symptoms, generalized anxiety symptoms, specific anxiety symptoms, quality of life or well-being, general distress, stress, mental disorder symptoms, psychosomatic disease symptoms, and positive and negative affect were considered eligible. This study followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Data were extracted by 2 independent reviewers, checked by a third reviewer, and pooled using both random effect models and fixed effects models. Hedges g was chosen as the effect size. ResultsOf the 6900 identified records, a total of 32 studies were included, involving 6089 participants. CAIs showed statistically significant short-term effects compared with control conditions in improving depressive symptoms (g=0.29, 95% CI 0.20-0.38), generalized anxiety symptoms (g=0.29, 95% CI 0.21-0.36), specific anxiety symptoms (g=0.47, 95% CI 0.07-0.86), quality of life or well-being (g=0.27, 95% CI 0.16-0.39), general distress (g=0.33, 95% CI 0.20-0.45), stress (g=0.24, 95% CI 0.08-0.41), mental disorder symptoms (g=0.36, 95% CI 0.17-0.54), psychosomatic disease symptoms (g=0.62, 95% CI 0.14-1.11), and negative affect (g=0.28, 95% CI 0.05-0.51). However, the long-term effects of CAIs for the most mental health outcomes were not statistically significant (g=−0.04 to 0.39). Personalization and empathic response were 2 critical facilitators of efficacy. The longer duration of interaction with conversational agents was associated with the larger pooled effect sizes. ConclusionsThe findings show that CAIs are research-proven interventions that ought to be implemented more widely in mental health care. CAIs are effective and easily acceptable for those with mental health problems. The clinical application of this novel digital technology will conserve human health resources and optimize the allocation of mental health services. Trial RegistrationPROSPERO CRD42022350130; https://tinyurl.com/mvhk6w9p
first_indexed 2024-03-12T12:38:31Z
format Article
id doaj.art-938cb1fd295c406fbe79a51fed4b2f89
institution Directory Open Access Journal
issn 1438-8871
language English
last_indexed 2024-03-12T12:38:31Z
publishDate 2023-04-01
publisher JMIR Publications
record_format Article
series Journal of Medical Internet Research
spelling doaj.art-938cb1fd295c406fbe79a51fed4b2f892023-08-28T23:59:19ZengJMIR PublicationsJournal of Medical Internet Research1438-88712023-04-0125e4386210.2196/43862Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled TrialsYuhao Hehttps://orcid.org/0000-0003-3969-7530Li Yanghttps://orcid.org/0000-0002-7947-0392Chunlian Qianhttps://orcid.org/0000-0001-7389-092XTong Lihttps://orcid.org/0009-0002-3789-6827Zhengyuan Suhttps://orcid.org/0009-0001-3664-0953Qiang Zhanghttps://orcid.org/0009-0009-3167-4052Xiangqing Houhttps://orcid.org/0000-0002-7142-3583 BackgroundMental health problems are a crucial global public health concern. Owing to their cost-effectiveness and accessibility, conversational agent interventions (CAIs) are promising in the field of mental health care. ObjectiveThis study aims to present a thorough summary of the traits of CAIs available for a range of mental health problems, find evidence of efficacy, and analyze the statistically significant moderators of efficacy via a meta-analysis of randomized controlled trial. MethodsWeb-based databases (Embase, MEDLINE, PsycINFO, CINAHL, Web of Science, and Cochrane) were systematically searched dated from the establishment of the database to October 30, 2021, and updated to May 1, 2022. Randomized controlled trials comparing CAIs with any other type of control condition in improving depressive symptoms, generalized anxiety symptoms, specific anxiety symptoms, quality of life or well-being, general distress, stress, mental disorder symptoms, psychosomatic disease symptoms, and positive and negative affect were considered eligible. This study followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Data were extracted by 2 independent reviewers, checked by a third reviewer, and pooled using both random effect models and fixed effects models. Hedges g was chosen as the effect size. ResultsOf the 6900 identified records, a total of 32 studies were included, involving 6089 participants. CAIs showed statistically significant short-term effects compared with control conditions in improving depressive symptoms (g=0.29, 95% CI 0.20-0.38), generalized anxiety symptoms (g=0.29, 95% CI 0.21-0.36), specific anxiety symptoms (g=0.47, 95% CI 0.07-0.86), quality of life or well-being (g=0.27, 95% CI 0.16-0.39), general distress (g=0.33, 95% CI 0.20-0.45), stress (g=0.24, 95% CI 0.08-0.41), mental disorder symptoms (g=0.36, 95% CI 0.17-0.54), psychosomatic disease symptoms (g=0.62, 95% CI 0.14-1.11), and negative affect (g=0.28, 95% CI 0.05-0.51). However, the long-term effects of CAIs for the most mental health outcomes were not statistically significant (g=−0.04 to 0.39). Personalization and empathic response were 2 critical facilitators of efficacy. The longer duration of interaction with conversational agents was associated with the larger pooled effect sizes. ConclusionsThe findings show that CAIs are research-proven interventions that ought to be implemented more widely in mental health care. CAIs are effective and easily acceptable for those with mental health problems. The clinical application of this novel digital technology will conserve human health resources and optimize the allocation of mental health services. Trial RegistrationPROSPERO CRD42022350130; https://tinyurl.com/mvhk6w9phttps://www.jmir.org/2023/1/e43862
spellingShingle Yuhao He
Li Yang
Chunlian Qian
Tong Li
Zhengyuan Su
Qiang Zhang
Xiangqing Hou
Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials
Journal of Medical Internet Research
title Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials
title_full Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials
title_fullStr Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials
title_full_unstemmed Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials
title_short Conversational Agent Interventions for Mental Health Problems: Systematic Review and Meta-analysis of Randomized Controlled Trials
title_sort conversational agent interventions for mental health problems systematic review and meta analysis of randomized controlled trials
url https://www.jmir.org/2023/1/e43862
work_keys_str_mv AT yuhaohe conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials
AT liyang conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials
AT chunlianqian conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials
AT tongli conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials
AT zhengyuansu conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials
AT qiangzhang conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials
AT xiangqinghou conversationalagentinterventionsformentalhealthproblemssystematicreviewandmetaanalysisofrandomizedcontrolledtrials