Temporal continuity of visual attention for future gaze prediction in immersive virtual reality
Background: Eye tracking technology is receiving increased attention in the field of virtual reality. Specifically, future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rendering, advertisement placement, and content-based design. To explore future gaze...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
KeAi Communications Co., Ltd.
2020-04-01
|
| Series: | Virtual Reality & Intelligent Hardware |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2096579620300188 |
| _version_ | 1818599922158534656 |
|---|---|
| author | Zhiming Hu Sheng Li Meng Gai |
| author_facet | Zhiming Hu Sheng Li Meng Gai |
| author_sort | Zhiming Hu |
| collection | DOAJ |
| description | Background: Eye tracking technology is receiving increased attention in the field of virtual reality. Specifically, future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rendering, advertisement placement, and content-based design. To explore future gaze prediction, it is necessary to analyze the temporal continuity of visual attention in immersive virtual reality. Methods: In this paper, the concept of temporal continuity of visual attention is presented. Subsequently, an autocorrelation function method is proposed to evaluate the temporal continuity. Thereafter, the temporal continuity is analyzed in both free-viewing and task-oriented conditions. Results: Specifically, in free-viewing conditions, the analysis of a free-viewing gaze dataset indicates that the temporal continuity performs well only within a short time interval. A task-oriented game scene condition was created and conducted to collect users' gaze data. An analysis of the collected gaze data finds the temporal continuity has a similar performance with that of the free-viewing conditions. Temporal continuity can be applied to future gaze prediction and if it is good, users' current gaze positions can be directly utilized to predict their gaze positions in the future. Conclusions: The current gaze's future prediction performances are further evaluated in both free-viewing and task-oriented conditions and discover that the current gaze can be efficiently applied to the task of short-term future gaze prediction. The task of long-term gaze prediction still remains to be explored. |
| first_indexed | 2024-12-16T12:27:17Z |
| format | Article |
| id | doaj.art-baa46769929047b4bcbff478eaf7f601 |
| institution | Directory Open Access Journal |
| issn | 2096-5796 |
| language | English |
| last_indexed | 2024-12-16T12:27:17Z |
| publishDate | 2020-04-01 |
| publisher | KeAi Communications Co., Ltd. |
| record_format | Article |
| series | Virtual Reality & Intelligent Hardware |
| spelling | doaj.art-baa46769929047b4bcbff478eaf7f6012022-12-21T22:31:48ZengKeAi Communications Co., Ltd.Virtual Reality & Intelligent Hardware2096-57962020-04-0122142152Temporal continuity of visual attention for future gaze prediction in immersive virtual realityZhiming Hu0Sheng Li1Meng Gai2Department of Computer Science and Technology, School of Electronic Engineering and Computer Science, Peking University, Beijing 100871, ChinaDepartment of Computer Science and Technology, School of Electronic Engineering and Computer Science, Peking University, Beijing 100871, China; Beijing Engineering Technology Research Center of Virtual Simulation and Visualization, Peking University, Beijing 100871, China; Corresponding author.Department of Computer Science and Technology, School of Electronic Engineering and Computer Science, Peking University, Beijing 100871, China; Beijing Engineering Technology Research Center of Virtual Simulation and Visualization, Peking University, Beijing 100871, ChinaBackground: Eye tracking technology is receiving increased attention in the field of virtual reality. Specifically, future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rendering, advertisement placement, and content-based design. To explore future gaze prediction, it is necessary to analyze the temporal continuity of visual attention in immersive virtual reality. Methods: In this paper, the concept of temporal continuity of visual attention is presented. Subsequently, an autocorrelation function method is proposed to evaluate the temporal continuity. Thereafter, the temporal continuity is analyzed in both free-viewing and task-oriented conditions. Results: Specifically, in free-viewing conditions, the analysis of a free-viewing gaze dataset indicates that the temporal continuity performs well only within a short time interval. A task-oriented game scene condition was created and conducted to collect users' gaze data. An analysis of the collected gaze data finds the temporal continuity has a similar performance with that of the free-viewing conditions. Temporal continuity can be applied to future gaze prediction and if it is good, users' current gaze positions can be directly utilized to predict their gaze positions in the future. Conclusions: The current gaze's future prediction performances are further evaluated in both free-viewing and task-oriented conditions and discover that the current gaze can be efficiently applied to the task of short-term future gaze prediction. The task of long-term gaze prediction still remains to be explored.http://www.sciencedirect.com/science/article/pii/S2096579620300188Temporal continuityVisual attentionAutocorrelation analysisGaze predictionVirtual reality |
| spellingShingle | Zhiming Hu Sheng Li Meng Gai Temporal continuity of visual attention for future gaze prediction in immersive virtual reality Virtual Reality & Intelligent Hardware Temporal continuity Visual attention Autocorrelation analysis Gaze prediction Virtual reality |
| title | Temporal continuity of visual attention for future gaze prediction in immersive virtual reality |
| title_full | Temporal continuity of visual attention for future gaze prediction in immersive virtual reality |
| title_fullStr | Temporal continuity of visual attention for future gaze prediction in immersive virtual reality |
| title_full_unstemmed | Temporal continuity of visual attention for future gaze prediction in immersive virtual reality |
| title_short | Temporal continuity of visual attention for future gaze prediction in immersive virtual reality |
| title_sort | temporal continuity of visual attention for future gaze prediction in immersive virtual reality |
| topic | Temporal continuity Visual attention Autocorrelation analysis Gaze prediction Virtual reality |
| url | http://www.sciencedirect.com/science/article/pii/S2096579620300188 |
| work_keys_str_mv | AT zhiminghu temporalcontinuityofvisualattentionforfuturegazepredictioninimmersivevirtualreality AT shengli temporalcontinuityofvisualattentionforfuturegazepredictioninimmersivevirtualreality AT menggai temporalcontinuityofvisualattentionforfuturegazepredictioninimmersivevirtualreality |