Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device

This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for...

Full description

Bibliographic Details
Main Authors: Katzschmann, Robert Kevin, Araki, Brandon, Rus, Daniela L
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2018
Online Access:http://hdl.handle.net/1721.1/114285
https://orcid.org/0000-0001-7143-7259
https://orcid.org/0000-0001-5473-3566
_version_ 1826199729429544960
author Katzschmann, Robert Kevin
Araki, Brandon
Rus, Daniela L
author2 Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
author_facet Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Katzschmann, Robert Kevin
Araki, Brandon
Rus, Daniela L
author_sort Katzschmann, Robert Kevin
collection MIT
description This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for safe local navigation in both confined and open spaces by enabling the user to distinguish free space from obstacles. The device presented is composed of two parts: a sensor belt and a haptic strap. The sensor belt is an array of time-of-flight distance sensors worn around the front of a user’s waist, and the pulses of infrared light provide reliable and accurate measurements of the distances between the user and surrounding obstacles or surfaces. The haptic strap communicates the measured distances through an array of vibratory motors worn around the user’s upper abdomen, providing haptic feedback. The linear vibration motors are combined with a point-loaded pretensioned applicator to transmit isolated vibrations to the user. We validated the device’s capability in an extensive user study entailing 162 trials with 12 blind users. Users wearing the device successfully walked through hallways, avoided obstacles, and detected staircases. Keywords: haptic interfaces; navigation; robot sensing systems; vibrations; belts; sensor arrays; cameras; assistive device; sightless navigation; human-robot interaction; perception; haptic feedback array
first_indexed 2024-09-23T11:24:50Z
format Article
id mit-1721.1/114285
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T11:24:50Z
publishDate 2018
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/1142852022-09-27T19:24:19Z Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device Katzschmann, Robert Kevin Araki, Brandon Rus, Daniela L Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Department of Mechanical Engineering Katzschmann, Robert Kevin Araki, Brandon Rus, Daniela L This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for safe local navigation in both confined and open spaces by enabling the user to distinguish free space from obstacles. The device presented is composed of two parts: a sensor belt and a haptic strap. The sensor belt is an array of time-of-flight distance sensors worn around the front of a user’s waist, and the pulses of infrared light provide reliable and accurate measurements of the distances between the user and surrounding obstacles or surfaces. The haptic strap communicates the measured distances through an array of vibratory motors worn around the user’s upper abdomen, providing haptic feedback. The linear vibration motors are combined with a point-loaded pretensioned applicator to transmit isolated vibrations to the user. We validated the device’s capability in an extensive user study entailing 162 trials with 12 blind users. Users wearing the device successfully walked through hallways, avoided obstacles, and detected staircases. Keywords: haptic interfaces; navigation; robot sensing systems; vibrations; belts; sensor arrays; cameras; assistive device; sightless navigation; human-robot interaction; perception; haptic feedback array National Science Foundation (U.S.) (Grant IIS1226883) 2018-03-26T13:41:51Z 2018-03-26T13:41:51Z 2018-03 2017-08 Article http://purl.org/eprint/type/JournalArticle 1534-4320 1558-0210 http://hdl.handle.net/1721.1/114285 Katzschmann, Robert et al. “Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device.” IEEE Transactions on Neural Systems and Rehabilitation Engineering 26, 3 (March 2018): 583 - 593 © 2018 Institute of Electrical and Electronics Engineers (IEEE) https://orcid.org/0000-0001-7143-7259 https://orcid.org/0000-0001-5473-3566 en_US http://dx.doi.org/10.1109/TNSRE.2018.2800665 IEEE Transactions on Neural Systems and Rehabilitation Engineering Creative Commons Attribution 3.0 Unported license http://creativecommons.org/licenses/by/3.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) Robert Katzschmann
spellingShingle Katzschmann, Robert Kevin
Araki, Brandon
Rus, Daniela L
Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device
title Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device
title_full Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device
title_fullStr Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device
title_full_unstemmed Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device
title_short Safe Local Navigation for Visually Impaired Users with a Time-of-Flight and Haptic Feedback Device
title_sort safe local navigation for visually impaired users with a time of flight and haptic feedback device
url http://hdl.handle.net/1721.1/114285
https://orcid.org/0000-0001-7143-7259
https://orcid.org/0000-0001-5473-3566
work_keys_str_mv AT katzschmannrobertkevin safelocalnavigationforvisuallyimpaireduserswithatimeofflightandhapticfeedbackdevice
AT arakibrandon safelocalnavigationforvisuallyimpaireduserswithatimeofflightandhapticfeedbackdevice
AT rusdanielal safelocalnavigationforvisuallyimpaireduserswithatimeofflightandhapticfeedbackdevice