Older adults' experience with virtual conversational agents for health data collection
IntroductionVirtual conversational agents (i.e., chatbots) are an intuitive form of data collection. Understanding older adults' experiences with chatbots could help identify their usability needs. This quality improvement study evaluated older adults' experiences with a chatbot for health...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-03-01
|
| Series: | Frontiers in Digital Health |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fdgth.2023.1125926/full |
| _version_ | 1797870470185353216 |
|---|---|
| author | Hattie Wilczewski Hiral Soni Julia Ivanova Triton Ong Janelle F. Barrera Janelle F. Barrera Brian E. Bunnell Brian E. Bunnell Brandon M. Welch Brandon M. Welch |
| author_facet | Hattie Wilczewski Hiral Soni Julia Ivanova Triton Ong Janelle F. Barrera Janelle F. Barrera Brian E. Bunnell Brian E. Bunnell Brandon M. Welch Brandon M. Welch |
| author_sort | Hattie Wilczewski |
| collection | DOAJ |
| description | IntroductionVirtual conversational agents (i.e., chatbots) are an intuitive form of data collection. Understanding older adults' experiences with chatbots could help identify their usability needs. This quality improvement study evaluated older adults' experiences with a chatbot for health data collection. A secondary goal was to understand how perceptions differed based on length of chatbot forms.MethodsAfter a demographic survey, participants (≥60 years) completed either a short (21 questions), moderate (30 questions), or long (66 questions) chatbot form. Perceived ease-of-use, usefulness, usability, likelihood to recommend, and cognitive load were measured post-test. Qualitative and quantitative analyses were used.ResultsA total of 260 participants reported on usability and satisfaction metrics including perceived ease-of-use (5.8/7), usefulness (4.7/7), usability (5.4/7), and likelihood to recommend (Net Promoter Score = 0). Cognitive load (12.3/100) was low. There was a statistically significant difference in perceived usefulness between groups, with a significantly higher mean perceived usefulness for Group 1 than Group 3. No other group differences were observed. The chatbot was perceived as quick, easy, and pleasant with concerns about technical issues, privacy, and security. Participants provided suggestions to enhance progress tracking, edit responses, improve readability, and have options to ask questions.DiscussionOlder adults found the chatbot to be easy, useful, and usable. The chatbot required low cognitive load demonstrating it could be an enjoyable health data collection tool for older adults. These results will inform the development of a health data collection chatbot technology. |
| first_indexed | 2024-04-10T00:29:02Z |
| format | Article |
| id | doaj.art-a654deaef3de436593153449dc4bcf67 |
| institution | Directory Open Access Journal |
| issn | 2673-253X |
| language | English |
| last_indexed | 2024-04-10T00:29:02Z |
| publishDate | 2023-03-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Digital Health |
| spelling | doaj.art-a654deaef3de436593153449dc4bcf672023-03-15T05:19:19ZengFrontiers Media S.A.Frontiers in Digital Health2673-253X2023-03-01510.3389/fdgth.2023.11259261125926Older adults' experience with virtual conversational agents for health data collectionHattie Wilczewski0Hiral Soni1Julia Ivanova2Triton Ong3Janelle F. Barrera4Janelle F. Barrera5Brian E. Bunnell6Brian E. Bunnell7Brandon M. Welch8Brandon M. Welch9Doxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDoxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDoxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDoxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDoxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDepartment of Psychiatry and Behavioral Neurosciences, University of South Florida, Tampa, FL, United StatesDoxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDepartment of Psychiatry and Behavioral Neurosciences, University of South Florida, Tampa, FL, United StatesDoxy.me Research, Doxy.me Inc., Rochester, NY, United StatesDepartment of Public Health Sciences, Medical University of South Carolina, Charleston, SC, United StatesIntroductionVirtual conversational agents (i.e., chatbots) are an intuitive form of data collection. Understanding older adults' experiences with chatbots could help identify their usability needs. This quality improvement study evaluated older adults' experiences with a chatbot for health data collection. A secondary goal was to understand how perceptions differed based on length of chatbot forms.MethodsAfter a demographic survey, participants (≥60 years) completed either a short (21 questions), moderate (30 questions), or long (66 questions) chatbot form. Perceived ease-of-use, usefulness, usability, likelihood to recommend, and cognitive load were measured post-test. Qualitative and quantitative analyses were used.ResultsA total of 260 participants reported on usability and satisfaction metrics including perceived ease-of-use (5.8/7), usefulness (4.7/7), usability (5.4/7), and likelihood to recommend (Net Promoter Score = 0). Cognitive load (12.3/100) was low. There was a statistically significant difference in perceived usefulness between groups, with a significantly higher mean perceived usefulness for Group 1 than Group 3. No other group differences were observed. The chatbot was perceived as quick, easy, and pleasant with concerns about technical issues, privacy, and security. Participants provided suggestions to enhance progress tracking, edit responses, improve readability, and have options to ask questions.DiscussionOlder adults found the chatbot to be easy, useful, and usable. The chatbot required low cognitive load demonstrating it could be an enjoyable health data collection tool for older adults. These results will inform the development of a health data collection chatbot technology.https://www.frontiersin.org/articles/10.3389/fdgth.2023.1125926/fullhealth data collectionolder adultsvirtual conversational agentschatbotuser experienceusability |
| spellingShingle | Hattie Wilczewski Hiral Soni Julia Ivanova Triton Ong Janelle F. Barrera Janelle F. Barrera Brian E. Bunnell Brian E. Bunnell Brandon M. Welch Brandon M. Welch Older adults' experience with virtual conversational agents for health data collection Frontiers in Digital Health health data collection older adults virtual conversational agents chatbot user experience usability |
| title | Older adults' experience with virtual conversational agents for health data collection |
| title_full | Older adults' experience with virtual conversational agents for health data collection |
| title_fullStr | Older adults' experience with virtual conversational agents for health data collection |
| title_full_unstemmed | Older adults' experience with virtual conversational agents for health data collection |
| title_short | Older adults' experience with virtual conversational agents for health data collection |
| title_sort | older adults experience with virtual conversational agents for health data collection |
| topic | health data collection older adults virtual conversational agents chatbot user experience usability |
| url | https://www.frontiersin.org/articles/10.3389/fdgth.2023.1125926/full |
| work_keys_str_mv | AT hattiewilczewski olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT hiralsoni olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT juliaivanova olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT tritonong olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT janellefbarrera olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT janellefbarrera olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT brianebunnell olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT brianebunnell olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT brandonmwelch olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection AT brandonmwelch olderadultsexperiencewithvirtualconversationalagentsforhealthdatacollection |