Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit

Autonomous driving system (ADS) is anticipated to revolutionize travel by reclaiming lost time and improve safety on the roads. With automation, user-engagements that enhances road monitoring should be considered to maintain vigilance and safety. From the literature, virtual reality (VR) usage in ca...

Full description

Bibliographic Details
Main Authors: Joseph Muguro, Pringgo Widyo Laksono, Yuta Sasatake, Muhammad Ilhamdi Rusydi, Kojiro Matsushita, Minoru Sasaki
Format: Article
Language:English
Published: Palacký University Olomouc 2023-04-01
Series:Transactions on Transport Sciences
Subjects:
Online Access:https://tots.upol.cz/artkey/tot-202301-0001_feasibility-of-ar-vr-use-in-autonomous-cars-for-user-engagements-and-its-effects-on-posture-and-vigilance-durin.php
_version_ 1797835590063882240
author Joseph Muguro
Pringgo Widyo Laksono
Yuta Sasatake
Muhammad Ilhamdi Rusydi
Kojiro Matsushita
Minoru Sasaki
author_facet Joseph Muguro
Pringgo Widyo Laksono
Yuta Sasatake
Muhammad Ilhamdi Rusydi
Kojiro Matsushita
Minoru Sasaki
author_sort Joseph Muguro
collection DOAJ
description Autonomous driving system (ADS) is anticipated to revolutionize travel by reclaiming lost time and improve safety on the roads. With automation, user-engagements that enhances road monitoring should be considered to maintain vigilance and safety. From the literature, virtual reality (VR) usage in cars offer productivity and increased privacy. This paper explores the efficacy of passenger use of VR headsets to enhance user-engagement during transit. User-engagement was quantified using physiological measures (pupillary response and electrodermal activity) during an in-car VR game/activity experiment. Further, the impacts of engaging with secondary tasks was evaluated using reaction time of pop-up objects. We designed a driving simulation with inbuilt entertaining activities, no-task, game-task, video-task, and mixed-task, played in a real car with a FOVE VR headset on the perimeter track of the Gifu University campus with 15 subjects (average 25.6 years, SD = 6.4). From reaction time, significant difference between tasks was found using one-way ANOVA (F(3,231) = 2.75, p = .0437). A post-hoc test revealed that game and mixed task reaction times were significantly different (p = .0126 and p = .016, respectively) suggesting that task design should consider hazard recognition in a real car. From physiological measures, an increased/sustained effect of user engagement was noted compared with baseline (no-task) suggesting effectiveness in maintaining vigilance. The results also reported a 10-fold improvement in sitting posture compared to baseline. The methodology employed is applicable as an indirect measure of engagement that would find use in productivity and vigilance study in an ADS.
first_indexed 2024-04-09T14:55:03Z
format Article
id doaj.art-1ff64b4754e647e79efb409234eeb3c2
institution Directory Open Access Journal
issn 1802-9876
language English
last_indexed 2024-04-09T14:55:03Z
publishDate 2023-04-01
publisher Palacký University Olomouc
record_format Article
series Transactions on Transport Sciences
spelling doaj.art-1ff64b4754e647e79efb409234eeb3c22023-05-02T06:20:42ZengPalacký University OlomoucTransactions on Transport Sciences1802-98762023-04-0114141310.5507/tots.2022.019tot-202301-0001Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transitJoseph MuguroPringgo Widyo LaksonoYuta SasatakeMuhammad Ilhamdi RusydiKojiro MatsushitaMinoru SasakiAutonomous driving system (ADS) is anticipated to revolutionize travel by reclaiming lost time and improve safety on the roads. With automation, user-engagements that enhances road monitoring should be considered to maintain vigilance and safety. From the literature, virtual reality (VR) usage in cars offer productivity and increased privacy. This paper explores the efficacy of passenger use of VR headsets to enhance user-engagement during transit. User-engagement was quantified using physiological measures (pupillary response and electrodermal activity) during an in-car VR game/activity experiment. Further, the impacts of engaging with secondary tasks was evaluated using reaction time of pop-up objects. We designed a driving simulation with inbuilt entertaining activities, no-task, game-task, video-task, and mixed-task, played in a real car with a FOVE VR headset on the perimeter track of the Gifu University campus with 15 subjects (average 25.6 years, SD = 6.4). From reaction time, significant difference between tasks was found using one-way ANOVA (F(3,231) = 2.75, p = .0437). A post-hoc test revealed that game and mixed task reaction times were significantly different (p = .0126 and p = .016, respectively) suggesting that task design should consider hazard recognition in a real car. From physiological measures, an increased/sustained effect of user engagement was noted compared with baseline (no-task) suggesting effectiveness in maintaining vigilance. The results also reported a 10-fold improvement in sitting posture compared to baseline. The methodology employed is applicable as an indirect measure of engagement that would find use in productivity and vigilance study in an ADS.https://tots.upol.cz/artkey/tot-202301-0001_feasibility-of-ar-vr-use-in-autonomous-cars-for-user-engagements-and-its-effects-on-posture-and-vigilance-durin.phpautonomous driving systems; driver/passenger engagement; driving related tasks3d-vr/arin-car vr
spellingShingle Joseph Muguro
Pringgo Widyo Laksono
Yuta Sasatake
Muhammad Ilhamdi Rusydi
Kojiro Matsushita
Minoru Sasaki
Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit
Transactions on Transport Sciences
autonomous driving systems; driver/passenger engagement; driving related tasks
3d-vr/ar
in-car vr
title Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit
title_full Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit
title_fullStr Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit
title_full_unstemmed Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit
title_short Feasibility of AR-VR use in autonomous cars for user engagements and its effects on posture and vigilance during transit
title_sort feasibility of ar vr use in autonomous cars for user engagements and its effects on posture and vigilance during transit
topic autonomous driving systems; driver/passenger engagement; driving related tasks
3d-vr/ar
in-car vr
url https://tots.upol.cz/artkey/tot-202301-0001_feasibility-of-ar-vr-use-in-autonomous-cars-for-user-engagements-and-its-effects-on-posture-and-vigilance-durin.php
work_keys_str_mv AT josephmuguro feasibilityofarvruseinautonomouscarsforuserengagementsanditseffectsonpostureandvigilanceduringtransit
AT pringgowidyolaksono feasibilityofarvruseinautonomouscarsforuserengagementsanditseffectsonpostureandvigilanceduringtransit
AT yutasasatake feasibilityofarvruseinautonomouscarsforuserengagementsanditseffectsonpostureandvigilanceduringtransit
AT muhammadilhamdirusydi feasibilityofarvruseinautonomouscarsforuserengagementsanditseffectsonpostureandvigilanceduringtransit
AT kojiromatsushita feasibilityofarvruseinautonomouscarsforuserengagementsanditseffectsonpostureandvigilanceduringtransit
AT minorusasaki feasibilityofarvruseinautonomouscarsforuserengagementsanditseffectsonpostureandvigilanceduringtransit