PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR

This study proposes a novel technology as a creative method to interact with an augmented reality (AR) system called PhoneCursor, which is incorporated onto head-mounted displays. PhoneCursor is designed to offer more intuitive, portable and natural interaction. Its technical realization combines th...

Full description

Bibliographic Details
Main Authors: Minghui Sun, Mingming Cao, Limin Wang, Qian Qian
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9057695/
_version_ 1819296360198832128
author Minghui Sun
Mingming Cao
Limin Wang
Qian Qian
author_facet Minghui Sun
Mingming Cao
Limin Wang
Qian Qian
author_sort Minghui Sun
collection DOAJ
description This study proposes a novel technology as a creative method to interact with an augmented reality (AR) system called PhoneCursor, which is incorporated onto head-mounted displays. PhoneCursor is designed to offer more intuitive, portable and natural interaction. Its technical realization combines the gyroscope and acceleration sensor based on mobile phone. In view of the target selection ability as a base function of PhoneCursor, it also enhances the performance in solving some difficult selection problems in AR, including far and small object selection, 3D occlusion, dense object selection, and batch selection problem. An experiment based on the ISO 9241-9 standard is conducted to investigate this ability, wherein the PhoneCursor technique is compared with the widely used and well-performing head-movement-based selection technique. Results show that PhoneCursor performs better in terms of movement time and throughput than the conventional technique. Some applications are further proposed to showcase the potential of using the PhoneCursor technique in AR scenarios.
first_indexed 2024-12-24T04:56:52Z
format Article
id doaj.art-1dde339e629f4c4482c3fff1c63689db
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-24T04:56:52Z
publishDate 2020-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-1dde339e629f4c4482c3fff1c63689db2022-12-21T17:14:22ZengIEEEIEEE Access2169-35362020-01-018706167062610.1109/ACCESS.2020.29860379057695PhoneCursor: Improving 3D Selection Performance With Mobile Device in ARMinghui Sun0https://orcid.org/0000-0002-1809-8187Mingming Cao1Limin Wang2https://orcid.org/0000-0003-2459-3907Qian Qian3College of Computer Science and Technology, Jilin University, Changchun, ChinaCollege of Software, Jilin University, Changchun, ChinaCollege of Computer Science and Technology, Jilin University, Changchun, ChinaComputer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Shanghai, ChinaThis study proposes a novel technology as a creative method to interact with an augmented reality (AR) system called PhoneCursor, which is incorporated onto head-mounted displays. PhoneCursor is designed to offer more intuitive, portable and natural interaction. Its technical realization combines the gyroscope and acceleration sensor based on mobile phone. In view of the target selection ability as a base function of PhoneCursor, it also enhances the performance in solving some difficult selection problems in AR, including far and small object selection, 3D occlusion, dense object selection, and batch selection problem. An experiment based on the ISO 9241-9 standard is conducted to investigate this ability, wherein the PhoneCursor technique is compared with the widely used and well-performing head-movement-based selection technique. Results show that PhoneCursor performs better in terms of movement time and throughput than the conventional technique. Some applications are further proposed to showcase the potential of using the PhoneCursor technique in AR scenarios.https://ieeexplore.ieee.org/document/9057695/Human computer interactioninteractive systems
spellingShingle Minghui Sun
Mingming Cao
Limin Wang
Qian Qian
PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR
IEEE Access
Human computer interaction
interactive systems
title PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR
title_full PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR
title_fullStr PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR
title_full_unstemmed PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR
title_short PhoneCursor: Improving 3D Selection Performance With Mobile Device in AR
title_sort phonecursor improving 3d selection performance with mobile device in ar
topic Human computer interaction
interactive systems
url https://ieeexplore.ieee.org/document/9057695/
work_keys_str_mv AT minghuisun phonecursorimproving3dselectionperformancewithmobiledeviceinar
AT mingmingcao phonecursorimproving3dselectionperformancewithmobiledeviceinar
AT liminwang phonecursorimproving3dselectionperformancewithmobiledeviceinar
AT qianqian phonecursorimproving3dselectionperformancewithmobiledeviceinar