Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis
BackgroundMental disorders (MDs) impose heavy burdens on health care (HC) systems and affect a growing number of people worldwide. The use of mobile health (mHealth) apps empowered by artificial intelligence (AI) is increasingly being resorted to as a possible solution....
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-12-01
|
| Series: | JMIR Human Factors |
| Online Access: | https://humanfactors.jmir.org/2022/4/e38799 |
| _version_ | 1797734558140989440 |
|---|---|
| author | Yi Shan Meng Ji Wenxiu Xie Kam-Yiu Lam Chi-Yin Chow |
| author_facet | Yi Shan Meng Ji Wenxiu Xie Kam-Yiu Lam Chi-Yin Chow |
| author_sort | Yi Shan |
| collection | DOAJ |
| description |
BackgroundMental disorders (MDs) impose heavy burdens on health care (HC) systems and affect a growing number of people worldwide. The use of mobile health (mHealth) apps empowered by artificial intelligence (AI) is increasingly being resorted to as a possible solution.
ObjectiveThis study adopted a topic modeling (TM) approach to investigate the public trust in AI apps in mental health care (MHC) by identifying the dominant topics and themes in user reviews of the 8 most relevant mental health (MH) apps with the largest numbers of reviewers.
MethodsWe searched Google Play for the top MH apps with the largest numbers of reviewers, from which we selected the most relevant apps. Subsequently, we extracted data from user reviews posted from January 1, 2020, to April 2, 2022. After cleaning the extracted data using the Python text processing tool spaCy, we ascertained the optimal number of topics, drawing on the coherence scores and used latent Dirichlet allocation (LDA) TM to generate the most salient topics and related terms. We then classified the ascertained topics into different theme categories by plotting them onto a 2D plane via multidimensional scaling using the pyLDAvis visualization tool. Finally, we analyzed these topics and themes qualitatively to better understand the status of public trust in AI apps in MHC.
ResultsFrom the top 20 MH apps with the largest numbers of reviewers retrieved, we chose the 8 (40%) most relevant apps: (1) Wysa: Anxiety Therapy Chatbot; (2) Youper Therapy; (3) MindDoc: Your Companion; (4) TalkLife for Anxiety, Depression & Stress; (5) 7 Cups: Online Therapy for Mental Health & Anxiety; (6) BetterHelp-Therapy; (7) Sanvello; and (8) InnerHour. These apps provided 14.2% (n=559), 11.0% (n=431), 13.7% (n=538), 8.8% (n=356), 14.1% (n=554), 11.9% (n=468), 9.2% (n=362), and 16.9% (n=663) of the collected 3931 reviews, respectively. The 4 dominant topics were topic 4 (cheering people up; n=1069, 27%), topic 3 (calming people down; n=1029, 26%), topic 2 (helping figure out the inner world; n=963, 25%), and topic 1 (being an alternative or complement to a therapist; n=870, 22%). Based on topic coherence and intertopic distance, topics 3 and 4 were combined into theme 3 (dispelling negative emotions), while topics 2 and 1 remained 2 separate themes: theme 2 (helping figure out the inner world) and theme 1 (being an alternative or complement to a therapist), respectively. These themes and topics, though involving some dissenting voices, reflected an overall high status of trust in AI apps.
ConclusionsThis is the first study to investigate the public trust in AI apps in MHC from the perspective of user reviews using the TM technique. The automatic text analysis and complementary manual interpretation of the collected data allowed us to discover the dominant topics hidden in a data set and categorize these topics into different themes to reveal an overall high degree of public trust. The dissenting voices from users, though only a few, can serve as indicators for health providers and app developers to jointly improve these apps, which will ultimately facilitate the treatment of prevalent MDs and alleviate the overburdened HC systems worldwide. |
| first_indexed | 2024-03-12T12:45:06Z |
| format | Article |
| id | doaj.art-147305edfe0a42298626512d817ee8c8 |
| institution | Directory Open Access Journal |
| issn | 2292-9495 |
| language | English |
| last_indexed | 2024-03-12T12:45:06Z |
| publishDate | 2022-12-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Human Factors |
| spelling | doaj.art-147305edfe0a42298626512d817ee8c82023-08-28T23:22:54ZengJMIR PublicationsJMIR Human Factors2292-94952022-12-0194e3879910.2196/38799Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling AnalysisYi Shanhttps://orcid.org/0000-0003-3168-1585Meng Jihttps://orcid.org/0000-0002-7463-9208Wenxiu Xiehttps://orcid.org/0000-0002-8528-5193Kam-Yiu Lamhttps://orcid.org/0000-0003-0673-3566Chi-Yin Chowhttps://orcid.org/0000-0002-9566-0743 BackgroundMental disorders (MDs) impose heavy burdens on health care (HC) systems and affect a growing number of people worldwide. The use of mobile health (mHealth) apps empowered by artificial intelligence (AI) is increasingly being resorted to as a possible solution. ObjectiveThis study adopted a topic modeling (TM) approach to investigate the public trust in AI apps in mental health care (MHC) by identifying the dominant topics and themes in user reviews of the 8 most relevant mental health (MH) apps with the largest numbers of reviewers. MethodsWe searched Google Play for the top MH apps with the largest numbers of reviewers, from which we selected the most relevant apps. Subsequently, we extracted data from user reviews posted from January 1, 2020, to April 2, 2022. After cleaning the extracted data using the Python text processing tool spaCy, we ascertained the optimal number of topics, drawing on the coherence scores and used latent Dirichlet allocation (LDA) TM to generate the most salient topics and related terms. We then classified the ascertained topics into different theme categories by plotting them onto a 2D plane via multidimensional scaling using the pyLDAvis visualization tool. Finally, we analyzed these topics and themes qualitatively to better understand the status of public trust in AI apps in MHC. ResultsFrom the top 20 MH apps with the largest numbers of reviewers retrieved, we chose the 8 (40%) most relevant apps: (1) Wysa: Anxiety Therapy Chatbot; (2) Youper Therapy; (3) MindDoc: Your Companion; (4) TalkLife for Anxiety, Depression & Stress; (5) 7 Cups: Online Therapy for Mental Health & Anxiety; (6) BetterHelp-Therapy; (7) Sanvello; and (8) InnerHour. These apps provided 14.2% (n=559), 11.0% (n=431), 13.7% (n=538), 8.8% (n=356), 14.1% (n=554), 11.9% (n=468), 9.2% (n=362), and 16.9% (n=663) of the collected 3931 reviews, respectively. The 4 dominant topics were topic 4 (cheering people up; n=1069, 27%), topic 3 (calming people down; n=1029, 26%), topic 2 (helping figure out the inner world; n=963, 25%), and topic 1 (being an alternative or complement to a therapist; n=870, 22%). Based on topic coherence and intertopic distance, topics 3 and 4 were combined into theme 3 (dispelling negative emotions), while topics 2 and 1 remained 2 separate themes: theme 2 (helping figure out the inner world) and theme 1 (being an alternative or complement to a therapist), respectively. These themes and topics, though involving some dissenting voices, reflected an overall high status of trust in AI apps. ConclusionsThis is the first study to investigate the public trust in AI apps in MHC from the perspective of user reviews using the TM technique. The automatic text analysis and complementary manual interpretation of the collected data allowed us to discover the dominant topics hidden in a data set and categorize these topics into different themes to reveal an overall high degree of public trust. The dissenting voices from users, though only a few, can serve as indicators for health providers and app developers to jointly improve these apps, which will ultimately facilitate the treatment of prevalent MDs and alleviate the overburdened HC systems worldwide.https://humanfactors.jmir.org/2022/4/e38799 |
| spellingShingle | Yi Shan Meng Ji Wenxiu Xie Kam-Yiu Lam Chi-Yin Chow Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis JMIR Human Factors |
| title | Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis |
| title_full | Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis |
| title_fullStr | Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis |
| title_full_unstemmed | Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis |
| title_short | Public Trust in Artificial Intelligence Applications in Mental Health Care: Topic Modeling Analysis |
| title_sort | public trust in artificial intelligence applications in mental health care topic modeling analysis |
| url | https://humanfactors.jmir.org/2022/4/e38799 |
| work_keys_str_mv | AT yishan publictrustinartificialintelligenceapplicationsinmentalhealthcaretopicmodelinganalysis AT mengji publictrustinartificialintelligenceapplicationsinmentalhealthcaretopicmodelinganalysis AT wenxiuxie publictrustinartificialintelligenceapplicationsinmentalhealthcaretopicmodelinganalysis AT kamyiulam publictrustinartificialintelligenceapplicationsinmentalhealthcaretopicmodelinganalysis AT chiyinchow publictrustinartificialintelligenceapplicationsinmentalhealthcaretopicmodelinganalysis |