In-vehicle air gesture design: impacts of display modality and control orientation

Abstract The number of visual distraction-caused crashes highlights a need for non-visual displays in the in-vehicle information system (IVIS). Audio-supported air gesture controls can tackle this problem. Twenty-four young drivers participated in our experiment using a driving simula...

Full description

Bibliographic Details
Main Authors: Sterkenburg, Jason, Landry, Steven, FakhrHosseini, Shabnam, Jeon, Myounghoon
Other Authors: AgeLab (Massachusetts Institute of Technology)
Format: Article
Language:English
Published: Springer International Publishing 2023
Online Access:https://hdl.handle.net/1721.1/152975
_version_ 1824457895020855296
author Sterkenburg, Jason
Landry, Steven
FakhrHosseini, Shabnam
Jeon, Myounghoon
author2 AgeLab (Massachusetts Institute of Technology)
author_facet AgeLab (Massachusetts Institute of Technology)
Sterkenburg, Jason
Landry, Steven
FakhrHosseini, Shabnam
Jeon, Myounghoon
author_sort Sterkenburg, Jason
collection MIT
description Abstract The number of visual distraction-caused crashes highlights a need for non-visual displays in the in-vehicle information system (IVIS). Audio-supported air gesture controls can tackle this problem. Twenty-four young drivers participated in our experiment using a driving simulator with six different gesture prototypes—3 modality types (visual-only, visual/auditory, and auditory-only) × 2 control orientation types (horizontal and vertical). Various data were obtained, including lane departures, eye glance behavior, secondary task performance, and driver workload. Results showed that the auditory-only displays showed a significantly lower lane departures and perceived workload. A tradeoff between eyes-on-road time and secondary task completion time for the auditory-only display was also observed, which means the safest, but slowest among the prototypes. Vertical controls (direct manipulation) showed significantly lower workload than horizontal controls (mouse metaphor), but did not differ in performance measures. Experimental results are discussed in the context of multiple resource theory and design guidelines for future implementation.
first_indexed 2024-09-23T08:46:12Z
format Article
id mit-1721.1/152975
institution Massachusetts Institute of Technology
language English
last_indexed 2025-02-19T04:17:15Z
publishDate 2023
publisher Springer International Publishing
record_format dspace
spelling mit-1721.1/1529752024-12-23T06:07:09Z In-vehicle air gesture design: impacts of display modality and control orientation Sterkenburg, Jason Landry, Steven FakhrHosseini, Shabnam Jeon, Myounghoon AgeLab (Massachusetts Institute of Technology) Abstract The number of visual distraction-caused crashes highlights a need for non-visual displays in the in-vehicle information system (IVIS). Audio-supported air gesture controls can tackle this problem. Twenty-four young drivers participated in our experiment using a driving simulator with six different gesture prototypes—3 modality types (visual-only, visual/auditory, and auditory-only) × 2 control orientation types (horizontal and vertical). Various data were obtained, including lane departures, eye glance behavior, secondary task performance, and driver workload. Results showed that the auditory-only displays showed a significantly lower lane departures and perceived workload. A tradeoff between eyes-on-road time and secondary task completion time for the auditory-only display was also observed, which means the safest, but slowest among the prototypes. Vertical controls (direct manipulation) showed significantly lower workload than horizontal controls (mouse metaphor), but did not differ in performance measures. Experimental results are discussed in the context of multiple resource theory and design guidelines for future implementation. 2023-11-15T14:22:18Z 2023-11-15T14:22:18Z 2023-09-14 2023-11-15T04:27:09Z Article http://purl.org/eprint/type/JournalArticle https://hdl.handle.net/1721.1/152975 Sterkenburg, Jason, Landry, Steven, FakhrHosseini, Shabnam and Jeon, Myounghoon. 2023. "In-vehicle air gesture design: impacts of display modality and control orientation." en https://doi.org/10.1007/s12193-023-00415-8 Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. The Author(s), under exclusive licence to Springer Nature Switzerland AG application/pdf Springer International Publishing Springer International Publishing
spellingShingle Sterkenburg, Jason
Landry, Steven
FakhrHosseini, Shabnam
Jeon, Myounghoon
In-vehicle air gesture design: impacts of display modality and control orientation
title In-vehicle air gesture design: impacts of display modality and control orientation
title_full In-vehicle air gesture design: impacts of display modality and control orientation
title_fullStr In-vehicle air gesture design: impacts of display modality and control orientation
title_full_unstemmed In-vehicle air gesture design: impacts of display modality and control orientation
title_short In-vehicle air gesture design: impacts of display modality and control orientation
title_sort in vehicle air gesture design impacts of display modality and control orientation
url https://hdl.handle.net/1721.1/152975
work_keys_str_mv AT sterkenburgjason invehicleairgesturedesignimpactsofdisplaymodalityandcontrolorientation
AT landrysteven invehicleairgesturedesignimpactsofdisplaymodalityandcontrolorientation
AT fakhrhosseinishabnam invehicleairgesturedesignimpactsofdisplaymodalityandcontrolorientation
AT jeonmyounghoon invehicleairgesturedesignimpactsofdisplaymodalityandcontrolorientation