An ARCore Based User Centric Assistive Navigation System for Visually Impaired People

In this work, we propose an assistive navigation system for visually impaired people (ANSVIP) that takes advantage of ARCore to acquire robust computer vision-based localization. To complete the system, we propose adaptive artificial potential field (AAPF) path planning that considers both efficienc...

Full description

Bibliographic Details
Main Authors: Xiaochen Zhang, Xiaoyu Yao, Yi Zhu, Fei Hu
Format: Article
Language:English
Published: MDPI AG 2019-03-01
Series:Applied Sciences
Subjects:
Online Access:http://www.mdpi.com/2076-3417/9/5/989
_version_ 1828858821214208000
author Xiaochen Zhang
Xiaoyu Yao
Yi Zhu
Fei Hu
author_facet Xiaochen Zhang
Xiaoyu Yao
Yi Zhu
Fei Hu
author_sort Xiaochen Zhang
collection DOAJ
description In this work, we propose an assistive navigation system for visually impaired people (ANSVIP) that takes advantage of ARCore to acquire robust computer vision-based localization. To complete the system, we propose adaptive artificial potential field (AAPF) path planning that considers both efficiency and safety. We also propose a dual-channel human–machine interaction mechanism, which delivers accurate and continuous directional micro-instruction via a haptic interface and macro-long-term planning and situational awareness via audio. Our system user-centrically incorporates haptic interfaces to provide fluent and continuous guidance superior to the conventional turn-by-turn audio-guiding method; moreover, the continuous guidance makes the path under complete control in avoiding obstacles and risky places. The system prototype is implemented with full functionality. Unit tests and simulations are conducted to evaluate the localization, path planning, and human–machine interactions, and the results show that the proposed solutions are superior to those of the present state-of-the-art solutions. Finally, integrated tests are carried out with low-vision and blind subjects to verify the proposed system.
first_indexed 2024-12-13T02:04:13Z
format Article
id doaj.art-4a492896d48642f49d0e02e92392cdaf
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-12-13T02:04:13Z
publishDate 2019-03-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-4a492896d48642f49d0e02e92392cdaf2022-12-22T00:03:10ZengMDPI AGApplied Sciences2076-34172019-03-019598910.3390/app9050989app9050989An ARCore Based User Centric Assistive Navigation System for Visually Impaired PeopleXiaochen Zhang0Xiaoyu Yao1Yi Zhu2Fei Hu3Department of Industrial Design, Guangdong University of Technology, Guangzhou 510006, ChinaDepartment of Industrial Design, Guangdong University of Technology, Guangzhou 510006, ChinaDepartment of Industrial Design, Guangdong University of Technology, Guangzhou 510006, ChinaDepartment of Industrial Design, Guangdong University of Technology, Guangzhou 510006, ChinaIn this work, we propose an assistive navigation system for visually impaired people (ANSVIP) that takes advantage of ARCore to acquire robust computer vision-based localization. To complete the system, we propose adaptive artificial potential field (AAPF) path planning that considers both efficiency and safety. We also propose a dual-channel human–machine interaction mechanism, which delivers accurate and continuous directional micro-instruction via a haptic interface and macro-long-term planning and situational awareness via audio. Our system user-centrically incorporates haptic interfaces to provide fluent and continuous guidance superior to the conventional turn-by-turn audio-guiding method; moreover, the continuous guidance makes the path under complete control in avoiding obstacles and risky places. The system prototype is implemented with full functionality. Unit tests and simulations are conducted to evaluate the localization, path planning, and human–machine interactions, and the results show that the proposed solutions are superior to those of the present state-of-the-art solutions. Finally, integrated tests are carried out with low-vision and blind subjects to verify the proposed system.http://www.mdpi.com/2076-3417/9/5/989assistive technologyARCoreuser centric designnavigation aidshaptic interactionadaptive path planningvisual impairmentSLAM
spellingShingle Xiaochen Zhang
Xiaoyu Yao
Yi Zhu
Fei Hu
An ARCore Based User Centric Assistive Navigation System for Visually Impaired People
Applied Sciences
assistive technology
ARCore
user centric design
navigation aids
haptic interaction
adaptive path planning
visual impairment
SLAM
title An ARCore Based User Centric Assistive Navigation System for Visually Impaired People
title_full An ARCore Based User Centric Assistive Navigation System for Visually Impaired People
title_fullStr An ARCore Based User Centric Assistive Navigation System for Visually Impaired People
title_full_unstemmed An ARCore Based User Centric Assistive Navigation System for Visually Impaired People
title_short An ARCore Based User Centric Assistive Navigation System for Visually Impaired People
title_sort arcore based user centric assistive navigation system for visually impaired people
topic assistive technology
ARCore
user centric design
navigation aids
haptic interaction
adaptive path planning
visual impairment
SLAM
url http://www.mdpi.com/2076-3417/9/5/989
work_keys_str_mv AT xiaochenzhang anarcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT xiaoyuyao anarcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT yizhu anarcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT feihu anarcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT xiaochenzhang arcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT xiaoyuyao arcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT yizhu arcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople
AT feihu arcorebasedusercentricassistivenavigationsystemforvisuallyimpairedpeople