Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception

Waiting is an indispensable and inevitable part of man-machine voice interaction. The voice user interface (VUI) feedback mechanism is a key factor affecting voice interaction’s waiting experience. The feedback time of most available voice interfaces is fixed or decided by the processing...

Full description

Bibliographic Details
Main Authors: Junfeng Wang, Yue Li, Shuyu Yang, Shiyu Dong, Jialin Li
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10056123/
_version_ 1811158509641793536
author Junfeng Wang
Yue Li
Shuyu Yang
Shiyu Dong
Jialin Li
author_facet Junfeng Wang
Yue Li
Shuyu Yang
Shiyu Dong
Jialin Li
author_sort Junfeng Wang
collection DOAJ
description Waiting is an indispensable and inevitable part of man-machine voice interaction. The voice user interface (VUI) feedback mechanism is a key factor affecting voice interaction’s waiting experience. The feedback time of most available voice interfaces is fixed or decided by the processing time of hardware and software, which has not been designed and cannot offer users a good interaction experience. In this paper, the speech rate of user-machine voice interaction is collected through prototype experimentation. Besides, users’ time perception of different voice interfaces’ feedback time settings is studied based on time psychology theories. Moreover, users’ emotional changes are described after a specific feedback time with the distribution of two-dimension arousal-valence emotion space. Users’ time perception and subjective emotions are differently influenced by different VUI feedback times. The experimental results show that 750 ms is the optimal VUI feedback time point at which the best users’ subjective feelings and psychological experiences are reached, and the threshold limit time spent by users in waiting for the VUI feedback is 1,850 ms which will lead to user emotions with low levels of arousal and valence after being exceeded. Based on that, a linear regression model is proposed to define the optimal feedback time of VUI. The user experience VUI research results show that the calculated feedback time parameters can make users produce time perception in line with their expectations in interacting with voice interfaces.
first_indexed 2024-04-10T05:25:44Z
format Article
id doaj.art-66a2babe4f994377a37195e85f9a158c
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-10T05:25:44Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-66a2babe4f994377a37195e85f9a158c2023-03-08T00:00:24ZengIEEEIEEE Access2169-35362023-01-0111212412125110.1109/ACCESS.2023.325027810056123Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time PerceptionJunfeng Wang0https://orcid.org/0000-0003-0685-7809Yue Li1Shuyu Yang2Shiyu Dong3Jialin Li4College of Design and Innovation, Shenzhen Technology University, Shenzhen, ChinaChina General Nuclear Power Group, Shenzhen, ChinaSchool of Manufacturing Science and Engineering, Southwest University of Science and Technology, Mianyang, ChinaCollege of Design and Innovation, Shenzhen Technology University, Shenzhen, ChinaCollege of Design and Innovation, Shenzhen Technology University, Shenzhen, ChinaWaiting is an indispensable and inevitable part of man-machine voice interaction. The voice user interface (VUI) feedback mechanism is a key factor affecting voice interaction’s waiting experience. The feedback time of most available voice interfaces is fixed or decided by the processing time of hardware and software, which has not been designed and cannot offer users a good interaction experience. In this paper, the speech rate of user-machine voice interaction is collected through prototype experimentation. Besides, users’ time perception of different voice interfaces’ feedback time settings is studied based on time psychology theories. Moreover, users’ emotional changes are described after a specific feedback time with the distribution of two-dimension arousal-valence emotion space. Users’ time perception and subjective emotions are differently influenced by different VUI feedback times. The experimental results show that 750 ms is the optimal VUI feedback time point at which the best users’ subjective feelings and psychological experiences are reached, and the threshold limit time spent by users in waiting for the VUI feedback is 1,850 ms which will lead to user emotions with low levels of arousal and valence after being exceeded. Based on that, a linear regression model is proposed to define the optimal feedback time of VUI. The user experience VUI research results show that the calculated feedback time parameters can make users produce time perception in line with their expectations in interacting with voice interfaces.https://ieeexplore.ieee.org/document/10056123/Voice user interfacefeedback timetime perceptionspeech rate
spellingShingle Junfeng Wang
Yue Li
Shuyu Yang
Shiyu Dong
Jialin Li
Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception
IEEE Access
Voice user interface
feedback time
time perception
speech rate
title Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception
title_full Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception
title_fullStr Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception
title_full_unstemmed Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception
title_short Waiting Experience: Optimization of Feedback Mechanism of Voice User Interfaces Based on Time Perception
title_sort waiting experience optimization of feedback mechanism of voice user interfaces based on time perception
topic Voice user interface
feedback time
time perception
speech rate
url https://ieeexplore.ieee.org/document/10056123/
work_keys_str_mv AT junfengwang waitingexperienceoptimizationoffeedbackmechanismofvoiceuserinterfacesbasedontimeperception
AT yueli waitingexperienceoptimizationoffeedbackmechanismofvoiceuserinterfacesbasedontimeperception
AT shuyuyang waitingexperienceoptimizationoffeedbackmechanismofvoiceuserinterfacesbasedontimeperception
AT shiyudong waitingexperienceoptimizationoffeedbackmechanismofvoiceuserinterfacesbasedontimeperception
AT jialinli waitingexperienceoptimizationoffeedbackmechanismofvoiceuserinterfacesbasedontimeperception