Natural multimodal interaction in immersive flow visualization
In the immersive flow visualization based on virtual reality, how to meet the needs of complex professional flow visualization analysis by natural human–computer interaction is a pressing problem. In order to achieve the natural and efficient human–computer interaction, we analyze the interaction re...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2021-12-01
|
| Series: | Visual Informatics |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2468502X21000632 |
| _version_ | 1818954274023931904 |
|---|---|
| author | Chengyu Su Chao Yang Yonghui Chen Fupan Wang Fang Wang Yadong Wu Xiaorong Zhang |
| author_facet | Chengyu Su Chao Yang Yonghui Chen Fupan Wang Fang Wang Yadong Wu Xiaorong Zhang |
| author_sort | Chengyu Su |
| collection | DOAJ |
| description | In the immersive flow visualization based on virtual reality, how to meet the needs of complex professional flow visualization analysis by natural human–computer interaction is a pressing problem. In order to achieve the natural and efficient human–computer interaction, we analyze the interaction requirements of flow visualization and study the characteristics of four human–computer interaction channels: hand, head, eye and voice. We give out some multimodal interaction design suggestions and then propose three multimodal interaction methods: head & hand, head & hand & eye and head & hand & eye & voice. The freedom of gestures, the stability of the head, the convenience of eyes and the rapid retrieval of voices are used to improve the accuracy and efficiency of interaction. The interaction load is balanced by multimodal interaction to reduce fatigue. The evaluation shows that our multimodal interaction has higher accuracy, faster time efficiency and much lower fatigue than the traditional joystick interaction. |
| first_indexed | 2024-12-20T10:19:33Z |
| format | Article |
| id | doaj.art-3f43ec135a7b42d388fe0908f125e695 |
| institution | Directory Open Access Journal |
| issn | 2468-502X |
| language | English |
| last_indexed | 2024-12-20T10:19:33Z |
| publishDate | 2021-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Visual Informatics |
| spelling | doaj.art-3f43ec135a7b42d388fe0908f125e6952022-12-21T19:43:57ZengElsevierVisual Informatics2468-502X2021-12-01545666Natural multimodal interaction in immersive flow visualizationChengyu Su0Chao Yang1Yonghui Chen2Fupan Wang3Fang Wang4Yadong Wu5Xiaorong Zhang6Southwest University of Science and Technology School of Computer Science and Tecnonology, China; Computational Aerodynamics Institute at China Aerodynamics Research and Development Center, ChinaComputational Aerodynamics Institute at China Aerodynamics Research and Development Center, ChinaSouthwest University of Science and Technology School of Computer Science and Tecnonology, ChinaSouthwest University of Science and Technology School of Computer Science and Tecnonology, ChinaComputational Aerodynamics Institute at China Aerodynamics Research and Development Center, ChinaSiChuan University of Science & Engineering, ChinaSouthwest University of Science and Technology School of Computer Science and Tecnonology, China; Corresponding author.In the immersive flow visualization based on virtual reality, how to meet the needs of complex professional flow visualization analysis by natural human–computer interaction is a pressing problem. In order to achieve the natural and efficient human–computer interaction, we analyze the interaction requirements of flow visualization and study the characteristics of four human–computer interaction channels: hand, head, eye and voice. We give out some multimodal interaction design suggestions and then propose three multimodal interaction methods: head & hand, head & hand & eye and head & hand & eye & voice. The freedom of gestures, the stability of the head, the convenience of eyes and the rapid retrieval of voices are used to improve the accuracy and efficiency of interaction. The interaction load is balanced by multimodal interaction to reduce fatigue. The evaluation shows that our multimodal interaction has higher accuracy, faster time efficiency and much lower fatigue than the traditional joystick interaction.http://www.sciencedirect.com/science/article/pii/S2468502X21000632Flow visualizationVirtual realityMultimodal interactionHuman–computer interaction |
| spellingShingle | Chengyu Su Chao Yang Yonghui Chen Fupan Wang Fang Wang Yadong Wu Xiaorong Zhang Natural multimodal interaction in immersive flow visualization Visual Informatics Flow visualization Virtual reality Multimodal interaction Human–computer interaction |
| title | Natural multimodal interaction in immersive flow visualization |
| title_full | Natural multimodal interaction in immersive flow visualization |
| title_fullStr | Natural multimodal interaction in immersive flow visualization |
| title_full_unstemmed | Natural multimodal interaction in immersive flow visualization |
| title_short | Natural multimodal interaction in immersive flow visualization |
| title_sort | natural multimodal interaction in immersive flow visualization |
| topic | Flow visualization Virtual reality Multimodal interaction Human–computer interaction |
| url | http://www.sciencedirect.com/science/article/pii/S2468502X21000632 |
| work_keys_str_mv | AT chengyusu naturalmultimodalinteractioninimmersiveflowvisualization AT chaoyang naturalmultimodalinteractioninimmersiveflowvisualization AT yonghuichen naturalmultimodalinteractioninimmersiveflowvisualization AT fupanwang naturalmultimodalinteractioninimmersiveflowvisualization AT fangwang naturalmultimodalinteractioninimmersiveflowvisualization AT yadongwu naturalmultimodalinteractioninimmersiveflowvisualization AT xiaorongzhang naturalmultimodalinteractioninimmersiveflowvisualization |