Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study
BackgroundUniversity students are increasingly reporting common mental health problems, such as stress, anxiety, and depression, and they frequently face barriers to seeking psychological support because of stigma, cost, and availability of mental health services. This issue is even more critical in...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2021-05-01
|
| Series: | JMIR mHealth and uHealth |
| Online Access: | https://mhealth.jmir.org/2021/5/e27965 |
| _version_ | 1818764897063796736 |
|---|---|
| author | Gabrielli, Silvia Rizzi, Silvia Bassi, Giulia Carbone, Sara Maimone, Rosa Marchesoni, Michele Forti, Stefano |
| author_facet | Gabrielli, Silvia Rizzi, Silvia Bassi, Giulia Carbone, Sara Maimone, Rosa Marchesoni, Michele Forti, Stefano |
| author_sort | Gabrielli, Silvia |
| collection | DOAJ |
| description | BackgroundUniversity students are increasingly reporting common mental health problems, such as stress, anxiety, and depression, and they frequently face barriers to seeking psychological support because of stigma, cost, and availability of mental health services. This issue is even more critical in the challenging time of the COVID-19 pandemic. Digital mental health interventions, such as those delivered via chatbots on mobile devices, offer the potential to achieve scalability of healthy-coping interventions by lowering cost and supporting prevention.
ObjectiveThe goal of this study was to conduct a proof-of-concept evaluation measuring the engagement and effectiveness of Atena, a psychoeducational chatbot supporting healthy coping with stress and anxiety, among a population of university students.
MethodsIn a proof-of-concept study, 71 university students were recruited during the COVID-19 pandemic; 68% (48/71) were female, they were all in their first year of university, and their mean age was 20.6 years (SD 2.4). Enrolled students were asked to use the Atena psychoeducational chatbot for 4 weeks (eight sessions; two per week), which provided healthy-coping strategies based on cognitive behavioral therapy, positive psychology, and mindfulness techniques. The intervention program consisted of conversations combined with audiovisual clips delivered via the Atena chatbot. Participants were asked to complete web-based versions of the 7-item Generalized Anxiety Disorder scale (GAD-7), the 10-item Perceived Stress Scale (PSS-10), and the Five-Facet Mindfulness Questionnaire (FFMQ) at baseline and postintervention to assess effectiveness. They were also asked to complete the User Engagement Scale–Short Form at week 2 to assess engagement with the chatbot and to provide qualitative comments on their overall experience with Atena postintervention.
ResultsParticipants engaged with the Atena chatbot an average of 78 (SD 24.8) times over the study period. A total of 61 out of 71 (86%) participants completed the first 2 weeks of the intervention and provided data on engagement (10/71, 14% attrition). A total of 41 participants out of 71 (58%) completed the full intervention and the postintervention questionnaires (30/71, 42% attrition). Results from the completer analysis showed a significant decrease in anxiety symptoms for participants in more extreme GAD-7 score ranges (t39=0.94; P=.009) and a decrease in stress symptoms as measured by the PSS-10 (t39=2.00; P=.05) for all participants postintervention. Participants also improved significantly in the describing and nonjudging facets, based on their FFMQ subscale scores, and asked for some improvements in the user experience with the chatbot.
ConclusionsThis study shows the benefit of deploying a digital healthy-coping intervention via a chatbot to support university students experiencing higher levels of distress. While findings collected during the COVID-19 pandemic show promise, further research is required to confirm conclusions. |
| first_indexed | 2024-12-18T08:09:29Z |
| format | Article |
| id | doaj.art-e2ab692fa79d41828bfdfdf063c5f93b |
| institution | Directory Open Access Journal |
| issn | 2291-5222 |
| language | English |
| last_indexed | 2024-12-18T08:09:29Z |
| publishDate | 2021-05-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR mHealth and uHealth |
| spelling | doaj.art-e2ab692fa79d41828bfdfdf063c5f93b2022-12-21T21:14:55ZengJMIR PublicationsJMIR mHealth and uHealth2291-52222021-05-0195e2796510.2196/27965Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept StudyGabrielli, SilviaRizzi, SilviaBassi, GiuliaCarbone, SaraMaimone, RosaMarchesoni, MicheleForti, StefanoBackgroundUniversity students are increasingly reporting common mental health problems, such as stress, anxiety, and depression, and they frequently face barriers to seeking psychological support because of stigma, cost, and availability of mental health services. This issue is even more critical in the challenging time of the COVID-19 pandemic. Digital mental health interventions, such as those delivered via chatbots on mobile devices, offer the potential to achieve scalability of healthy-coping interventions by lowering cost and supporting prevention. ObjectiveThe goal of this study was to conduct a proof-of-concept evaluation measuring the engagement and effectiveness of Atena, a psychoeducational chatbot supporting healthy coping with stress and anxiety, among a population of university students. MethodsIn a proof-of-concept study, 71 university students were recruited during the COVID-19 pandemic; 68% (48/71) were female, they were all in their first year of university, and their mean age was 20.6 years (SD 2.4). Enrolled students were asked to use the Atena psychoeducational chatbot for 4 weeks (eight sessions; two per week), which provided healthy-coping strategies based on cognitive behavioral therapy, positive psychology, and mindfulness techniques. The intervention program consisted of conversations combined with audiovisual clips delivered via the Atena chatbot. Participants were asked to complete web-based versions of the 7-item Generalized Anxiety Disorder scale (GAD-7), the 10-item Perceived Stress Scale (PSS-10), and the Five-Facet Mindfulness Questionnaire (FFMQ) at baseline and postintervention to assess effectiveness. They were also asked to complete the User Engagement Scale–Short Form at week 2 to assess engagement with the chatbot and to provide qualitative comments on their overall experience with Atena postintervention. ResultsParticipants engaged with the Atena chatbot an average of 78 (SD 24.8) times over the study period. A total of 61 out of 71 (86%) participants completed the first 2 weeks of the intervention and provided data on engagement (10/71, 14% attrition). A total of 41 participants out of 71 (58%) completed the full intervention and the postintervention questionnaires (30/71, 42% attrition). Results from the completer analysis showed a significant decrease in anxiety symptoms for participants in more extreme GAD-7 score ranges (t39=0.94; P=.009) and a decrease in stress symptoms as measured by the PSS-10 (t39=2.00; P=.05) for all participants postintervention. Participants also improved significantly in the describing and nonjudging facets, based on their FFMQ subscale scores, and asked for some improvements in the user experience with the chatbot. ConclusionsThis study shows the benefit of deploying a digital healthy-coping intervention via a chatbot to support university students experiencing higher levels of distress. While findings collected during the COVID-19 pandemic show promise, further research is required to confirm conclusions.https://mhealth.jmir.org/2021/5/e27965 |
| spellingShingle | Gabrielli, Silvia Rizzi, Silvia Bassi, Giulia Carbone, Sara Maimone, Rosa Marchesoni, Michele Forti, Stefano Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study JMIR mHealth and uHealth |
| title | Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study |
| title_full | Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study |
| title_fullStr | Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study |
| title_full_unstemmed | Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study |
| title_short | Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study |
| title_sort | engagement and effectiveness of a healthy coping intervention via chatbot for university students during the covid 19 pandemic mixed methods proof of concept study |
| url | https://mhealth.jmir.org/2021/5/e27965 |
| work_keys_str_mv | AT gabriellisilvia engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy AT rizzisilvia engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy AT bassigiulia engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy AT carbonesara engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy AT maimonerosa engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy AT marchesonimichele engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy AT fortistefano engagementandeffectivenessofahealthycopinginterventionviachatbotforuniversitystudentsduringthecovid19pandemicmixedmethodsproofofconceptstudy |