GazeHand: A Gaze-Driven Virtual Hand Interface

In this paper, we present a novel interface named GazeHand which is designed for distant object interaction in virtual reality. The GazeHand interface translates the virtual hands near to a distant object that the user is looking at and allows direct hand gesture interaction for manipulating an obje...

Full description

Bibliographic Details
Main Authors: Jaejoon Jeong, Soo-Hyung Kim, Hyung-Jeong Yang, Gun A. Lee, Seungwon Kim
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10332195/
_version_ 1797400995851927552
author Jaejoon Jeong
Soo-Hyung Kim
Hyung-Jeong Yang
Gun A. Lee
Seungwon Kim
author_facet Jaejoon Jeong
Soo-Hyung Kim
Hyung-Jeong Yang
Gun A. Lee
Seungwon Kim
author_sort Jaejoon Jeong
collection DOAJ
description In this paper, we present a novel interface named GazeHand which is designed for distant object interaction in virtual reality. The GazeHand interface translates the virtual hands near to a distant object that the user is looking at and allows direct hand gesture interaction for manipulating an object. Either eye-gaze or head-gaze can be applied to the GazeHand interface to decide the translated positions of the hands. In a user study, we compared these two variants of the GazeHand interface, i.e., Eye-GazeHand and Head-GazeHand, with a baseline condition of a modified Go-Go interface. The results showed that both GazeHand interfaces support the high-level usability of the direct hand operation for distant object interaction while providing the benefits of the gaze interaction: speed and reachability. The two variants of GazeHand interfaces showed better performance than the modified Go-Go interface and the effects were more prominent as the difficulty level of the task increased. The most preferred interface was the Head-GazeHand which took the benefit of a stable head-gaze, while the Eye-GazeHand was less stable using eye-gaze. Meanwhile, the Eye-GazeHand interface showed its advantage over the Head-GazeHand when the task required much gaze movement as it used faster eye-gaze without requiring head movement.
first_indexed 2024-03-09T02:03:30Z
format Article
id doaj.art-2a9490b58f104e3985f8a8524a1639fc
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-09T02:03:30Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-2a9490b58f104e3985f8a8524a1639fc2023-12-08T00:07:22ZengIEEEIEEE Access2169-35362023-01-011113370313371610.1109/ACCESS.2023.333737210332195GazeHand: A Gaze-Driven Virtual Hand InterfaceJaejoon Jeong0https://orcid.org/0009-0005-9734-2182Soo-Hyung Kim1https://orcid.org/0000-0003-3575-5035Hyung-Jeong Yang2https://orcid.org/0000-0003-3024-5060Gun A. Lee3https://orcid.org/0000-0002-1644-6934Seungwon Kim4https://orcid.org/0000-0003-4221-3058Department of Software Engineering, Chonnam National University, Gwangju, South KoreaSchool of Artificial Intelligence, Chonnam National University, Gwangju, South KoreaDepartment of Artificial Intelligence Convergence, Chonnam National University, Gwangju, South KoreaUniversity of South Australia, Adelaide, SA, AustraliaSchool of Artificial Intelligence, Chonnam National University, Gwangju, South KoreaIn this paper, we present a novel interface named GazeHand which is designed for distant object interaction in virtual reality. The GazeHand interface translates the virtual hands near to a distant object that the user is looking at and allows direct hand gesture interaction for manipulating an object. Either eye-gaze or head-gaze can be applied to the GazeHand interface to decide the translated positions of the hands. In a user study, we compared these two variants of the GazeHand interface, i.e., Eye-GazeHand and Head-GazeHand, with a baseline condition of a modified Go-Go interface. The results showed that both GazeHand interfaces support the high-level usability of the direct hand operation for distant object interaction while providing the benefits of the gaze interaction: speed and reachability. The two variants of GazeHand interfaces showed better performance than the modified Go-Go interface and the effects were more prominent as the difficulty level of the task increased. The most preferred interface was the Head-GazeHand which took the benefit of a stable head-gaze, while the Eye-GazeHand was less stable using eye-gaze. Meanwhile, the Eye-GazeHand interface showed its advantage over the Head-GazeHand when the task required much gaze movement as it used faster eye-gaze without requiring head movement.https://ieeexplore.ieee.org/document/10332195/Distant object interactionpivot pointvirtual handvirtual reality
spellingShingle Jaejoon Jeong
Soo-Hyung Kim
Hyung-Jeong Yang
Gun A. Lee
Seungwon Kim
GazeHand: A Gaze-Driven Virtual Hand Interface
IEEE Access
Distant object interaction
pivot point
virtual hand
virtual reality
title GazeHand: A Gaze-Driven Virtual Hand Interface
title_full GazeHand: A Gaze-Driven Virtual Hand Interface
title_fullStr GazeHand: A Gaze-Driven Virtual Hand Interface
title_full_unstemmed GazeHand: A Gaze-Driven Virtual Hand Interface
title_short GazeHand: A Gaze-Driven Virtual Hand Interface
title_sort gazehand a gaze driven virtual hand interface
topic Distant object interaction
pivot point
virtual hand
virtual reality
url https://ieeexplore.ieee.org/document/10332195/
work_keys_str_mv AT jaejoonjeong gazehandagazedrivenvirtualhandinterface
AT soohyungkim gazehandagazedrivenvirtualhandinterface
AT hyungjeongyang gazehandagazedrivenvirtualhandinterface
AT gunalee gazehandagazedrivenvirtualhandinterface
AT seungwonkim gazehandagazedrivenvirtualhandinterface