Digital Mental Health Interventions for Depression: Scoping Review of User Engagement
BackgroundWhile many digital mental health interventions (DMHIs) have been found to be efficacious, patient engagement with DMHIs has increasingly emerged as a concern for implementation in real-world clinical settings. To address engagement, we must first understand what sta...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-10-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2022/10/e39204 |
| _version_ | 1827857851867987968 |
|---|---|
| author | Jessica M Lipschitz Rachel Van Boxtel John Torous Joseph Firth Julia G Lebovitz Katherine E Burdick Timothy P Hogan |
| author_facet | Jessica M Lipschitz Rachel Van Boxtel John Torous Joseph Firth Julia G Lebovitz Katherine E Burdick Timothy P Hogan |
| author_sort | Jessica M Lipschitz |
| collection | DOAJ |
| description |
BackgroundWhile many digital mental health interventions (DMHIs) have been found to be efficacious, patient engagement with DMHIs has increasingly emerged as a concern for implementation in real-world clinical settings. To address engagement, we must first understand what standard engagement levels are in the context of randomized controlled trials (RCTs) and how these compare with other treatments.
ObjectiveThis scoping review aims to examine the state of reporting on intervention engagement in RCTs of mobile app–based interventions intended to treat symptoms of depression. We sought to identify what engagement metrics are and are not routinely reported as well as what the metrics that are reported reflect about standard engagement levels.
MethodsWe conducted a systematic search of 7 databases to identify studies meeting our eligibility criteria, namely, RCTs that evaluated use of a mobile app–based intervention in adults, for which depressive symptoms were a primary outcome of interest. We then extracted 2 kinds of information from each article: intervention details and indices of DMHI engagement. A 5-element framework of minimum necessary DMHI engagement reporting was derived by our team and guided our data extraction. This framework included (1) recommended app use as communicated to participants at enrollment and, when reported, app adherence criteria; (2) rate of intervention uptake among those assigned to the intervention; (3) level of app use metrics reported, specifically number of uses and time spent using the app; (4) duration of app use metrics (ie, weekly use patterns); and (5) number of intervention completers.
ResultsDatabase searching yielded 2083 unique records. Of these, 22 studies were eligible for inclusion. Only 64% (14/22) of studies included in this review specified rate of intervention uptake. Level of use metrics was only reported in 59% (13/22) of the studies reviewed. Approximately one-quarter of the studies (5/22, 23%) reported duration of use metrics. Only half (11/22, 50%) of the studies reported the number of participants who completed the app-based components of the intervention as intended or other metrics related to completion. Findings in those studies reporting metrics related to intervention completion indicated that between 14.4% and 93.0% of participants randomized to a DMHI condition completed the intervention as intended or according to a specified adherence criteria.
ConclusionsFindings suggest that engagement was underreported and widely varied. It was not uncommon to see completion rates at or below 50% (11/22) of those participants randomized to a treatment condition or to simply see completion rates not reported at all. This variability in reporting suggests a failure to establish sufficient reporting standards and limits the conclusions that can be drawn about level of engagement with DMHIs. Based on these findings, the 5-element framework applied in this review may be useful as a minimum necessary standard for DMHI engagement reporting. |
| first_indexed | 2024-03-12T12:47:15Z |
| format | Article |
| id | doaj.art-464b16e6df4f47d68bbab1742a33c90e |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-03-12T12:47:15Z |
| publishDate | 2022-10-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-464b16e6df4f47d68bbab1742a33c90e2023-08-28T23:16:10ZengJMIR PublicationsJournal of Medical Internet Research1438-88712022-10-012410e3920410.2196/39204Digital Mental Health Interventions for Depression: Scoping Review of User EngagementJessica M Lipschitzhttps://orcid.org/0000-0002-4085-0507Rachel Van Boxtelhttps://orcid.org/0000-0002-7859-0739John Toroushttps://orcid.org/0000-0002-5362-7937Joseph Firthhttps://orcid.org/0000-0002-0618-2752Julia G Lebovitzhttps://orcid.org/0000-0002-6377-5706Katherine E Burdickhttps://orcid.org/0000-0003-4417-4988Timothy P Hoganhttps://orcid.org/0000-0002-6888-0927 BackgroundWhile many digital mental health interventions (DMHIs) have been found to be efficacious, patient engagement with DMHIs has increasingly emerged as a concern for implementation in real-world clinical settings. To address engagement, we must first understand what standard engagement levels are in the context of randomized controlled trials (RCTs) and how these compare with other treatments. ObjectiveThis scoping review aims to examine the state of reporting on intervention engagement in RCTs of mobile app–based interventions intended to treat symptoms of depression. We sought to identify what engagement metrics are and are not routinely reported as well as what the metrics that are reported reflect about standard engagement levels. MethodsWe conducted a systematic search of 7 databases to identify studies meeting our eligibility criteria, namely, RCTs that evaluated use of a mobile app–based intervention in adults, for which depressive symptoms were a primary outcome of interest. We then extracted 2 kinds of information from each article: intervention details and indices of DMHI engagement. A 5-element framework of minimum necessary DMHI engagement reporting was derived by our team and guided our data extraction. This framework included (1) recommended app use as communicated to participants at enrollment and, when reported, app adherence criteria; (2) rate of intervention uptake among those assigned to the intervention; (3) level of app use metrics reported, specifically number of uses and time spent using the app; (4) duration of app use metrics (ie, weekly use patterns); and (5) number of intervention completers. ResultsDatabase searching yielded 2083 unique records. Of these, 22 studies were eligible for inclusion. Only 64% (14/22) of studies included in this review specified rate of intervention uptake. Level of use metrics was only reported in 59% (13/22) of the studies reviewed. Approximately one-quarter of the studies (5/22, 23%) reported duration of use metrics. Only half (11/22, 50%) of the studies reported the number of participants who completed the app-based components of the intervention as intended or other metrics related to completion. Findings in those studies reporting metrics related to intervention completion indicated that between 14.4% and 93.0% of participants randomized to a DMHI condition completed the intervention as intended or according to a specified adherence criteria. ConclusionsFindings suggest that engagement was underreported and widely varied. It was not uncommon to see completion rates at or below 50% (11/22) of those participants randomized to a treatment condition or to simply see completion rates not reported at all. This variability in reporting suggests a failure to establish sufficient reporting standards and limits the conclusions that can be drawn about level of engagement with DMHIs. Based on these findings, the 5-element framework applied in this review may be useful as a minimum necessary standard for DMHI engagement reporting.https://www.jmir.org/2022/10/e39204 |
| spellingShingle | Jessica M Lipschitz Rachel Van Boxtel John Torous Joseph Firth Julia G Lebovitz Katherine E Burdick Timothy P Hogan Digital Mental Health Interventions for Depression: Scoping Review of User Engagement Journal of Medical Internet Research |
| title | Digital Mental Health Interventions for Depression: Scoping Review of User Engagement |
| title_full | Digital Mental Health Interventions for Depression: Scoping Review of User Engagement |
| title_fullStr | Digital Mental Health Interventions for Depression: Scoping Review of User Engagement |
| title_full_unstemmed | Digital Mental Health Interventions for Depression: Scoping Review of User Engagement |
| title_short | Digital Mental Health Interventions for Depression: Scoping Review of User Engagement |
| title_sort | digital mental health interventions for depression scoping review of user engagement |
| url | https://www.jmir.org/2022/10/e39204 |
| work_keys_str_mv | AT jessicamlipschitz digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement AT rachelvanboxtel digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement AT johntorous digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement AT josephfirth digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement AT juliaglebovitz digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement AT katherineeburdick digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement AT timothyphogan digitalmentalhealthinterventionsfordepressionscopingreviewofuserengagement |