Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing
Utilizing immersive technologies to reintroduce the environmental context (i.e., visual, auditory, and olfactory cues) in sensory testing has been one area of research for improving panelist engagement. The current study sought to understand whether pairing smart-speaker questionnaires in immersive...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-06-01
|
| Series: | Foods |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2304-8158/12/13/2537 |
| _version_ | 1797591700427767808 |
|---|---|
| author | Ashley M. Soldavini Hamza Diaz John M. Ennis Christopher T. Simons |
| author_facet | Ashley M. Soldavini Hamza Diaz John M. Ennis Christopher T. Simons |
| author_sort | Ashley M. Soldavini |
| collection | DOAJ |
| description | Utilizing immersive technologies to reintroduce the environmental context (i.e., visual, auditory, and olfactory cues) in sensory testing has been one area of research for improving panelist engagement. The current study sought to understand whether pairing smart-speaker questionnaires in immersive spaces could positively affect the panelist experience through enhanced ecological validity. To this end, subjects performed an immersive consumer test in which responses were collected using a traditional computer-based survey, a smart-speaker approach incorporating a direct translation of the computer questionnaire into a verbal survey requiring numeric responses, and an optimized smart-speaker survey with alternative question formatting requiring spoken word-based responses. After testing, participants answered the Engagement Questionnaire (EQ) to assess participant engagement during the test, and the System Usability Scale (SUS) survey to understand the ease, and potential adoption, of using the various survey technologies in the study. Results indicated that the traditional computer-based survey was the most engaging (<i>p</i> < 0.001) and usable (<i>p</i> < 0.001), with no differences found between the two smart-speaker surveys (<i>p</i> = 0.803 and <i>p</i> = 0.577, respectively). This suggests that the proposed optimizations for the smart-speaker surveys were not robust enough to influence engagement and usability, and further research is needed to enhance their conversational capabilities. |
| first_indexed | 2024-03-11T01:40:58Z |
| format | Article |
| id | doaj.art-54e1fcb85f61402187e6b905a2ad9bdc |
| institution | Directory Open Access Journal |
| issn | 2304-8158 |
| language | English |
| last_indexed | 2024-03-11T01:40:58Z |
| publishDate | 2023-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Foods |
| spelling | doaj.art-54e1fcb85f61402187e6b905a2ad9bdc2023-11-18T16:33:56ZengMDPI AGFoods2304-81582023-06-011213253710.3390/foods12132537Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer TestingAshley M. Soldavini0Hamza Diaz1John M. Ennis2Christopher T. Simons3Department of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd., Columbus, OH 43210, USAAigora LLC, 2515 Whispering Oaks Ct., Midlothian, VA 23112, USAAigora LLC, 2515 Whispering Oaks Ct., Midlothian, VA 23112, USADepartment of Food Science & Technology, The Ohio State University, 2015 Fyffe Rd., Columbus, OH 43210, USAUtilizing immersive technologies to reintroduce the environmental context (i.e., visual, auditory, and olfactory cues) in sensory testing has been one area of research for improving panelist engagement. The current study sought to understand whether pairing smart-speaker questionnaires in immersive spaces could positively affect the panelist experience through enhanced ecological validity. To this end, subjects performed an immersive consumer test in which responses were collected using a traditional computer-based survey, a smart-speaker approach incorporating a direct translation of the computer questionnaire into a verbal survey requiring numeric responses, and an optimized smart-speaker survey with alternative question formatting requiring spoken word-based responses. After testing, participants answered the Engagement Questionnaire (EQ) to assess participant engagement during the test, and the System Usability Scale (SUS) survey to understand the ease, and potential adoption, of using the various survey technologies in the study. Results indicated that the traditional computer-based survey was the most engaging (<i>p</i> < 0.001) and usable (<i>p</i> < 0.001), with no differences found between the two smart-speaker surveys (<i>p</i> = 0.803 and <i>p</i> = 0.577, respectively). This suggests that the proposed optimizations for the smart-speaker surveys were not robust enough to influence engagement and usability, and further research is needed to enhance their conversational capabilities.https://www.mdpi.com/2304-8158/12/13/2537engagementSystem Usability Scale scoreAmazon Alexasensory testingimmersive technologies |
| spellingShingle | Ashley M. Soldavini Hamza Diaz John M. Ennis Christopher T. Simons Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing Foods engagement System Usability Scale score Amazon Alexa sensory testing immersive technologies |
| title | Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing |
| title_full | Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing |
| title_fullStr | Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing |
| title_full_unstemmed | Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing |
| title_short | Understanding the Effects of Smart-Speaker-Based Surveys on Panelist Experience in Immersive Consumer Testing |
| title_sort | understanding the effects of smart speaker based surveys on panelist experience in immersive consumer testing |
| topic | engagement System Usability Scale score Amazon Alexa sensory testing immersive technologies |
| url | https://www.mdpi.com/2304-8158/12/13/2537 |
| work_keys_str_mv | AT ashleymsoldavini understandingtheeffectsofsmartspeakerbasedsurveysonpanelistexperienceinimmersiveconsumertesting AT hamzadiaz understandingtheeffectsofsmartspeakerbasedsurveysonpanelistexperienceinimmersiveconsumertesting AT johnmennis understandingtheeffectsofsmartspeakerbasedsurveysonpanelistexperienceinimmersiveconsumertesting AT christophertsimons understandingtheeffectsofsmartspeakerbasedsurveysonpanelistexperienceinimmersiveconsumertesting |