Intention-Aware Pedestrian Avoidance

A critical component of autonomous driving in urban environment is the vehicle’s ability to interact safely and intelligently with the human drivers and on-road pedestrians. This requires identifying the human intentions in real time based on a limited observation history and reacting accordingly. I...

Full description

Bibliographic Details
Main Authors: Bandyopadhyay, Tirthankar, Jie, Chong Zhuang, Hsu, David, Ang, Marcelo H., Rus, Daniela L, Frazzoli, Emilio
Other Authors: Singapore-MIT Alliance in Research and Technology (SMART)
Format: Book
Language:English
Published: Springer International Publishing 2021
Online Access:https://hdl.handle.net/1721.1/129707
_version_ 1826210716277800960
author Bandyopadhyay, Tirthankar
Jie, Chong Zhuang
Hsu, David
Ang, Marcelo H.
Rus, Daniela L
Frazzoli, Emilio
author2 Singapore-MIT Alliance in Research and Technology (SMART)
author_facet Singapore-MIT Alliance in Research and Technology (SMART)
Bandyopadhyay, Tirthankar
Jie, Chong Zhuang
Hsu, David
Ang, Marcelo H.
Rus, Daniela L
Frazzoli, Emilio
author_sort Bandyopadhyay, Tirthankar
collection MIT
description A critical component of autonomous driving in urban environment is the vehicle’s ability to interact safely and intelligently with the human drivers and on-road pedestrians. This requires identifying the human intentions in real time based on a limited observation history and reacting accordingly. In the context of pedestrian avoidance, traditional approaches like proximity based reactive avoidance, or taking the most likely behavior of the pedestrian into account, often fail to generate a safe and successful avoidance strategy. This is mainly because they fail to take into account the human intention and the inherent uncertainty resulting in identifying such intentions from direct observations. This work formulates the on-road pedestrian avoidance problem as an instance of the Intention-Aware Motion Planning (IAMP) problem, where the human intention uncertainty is incorporated in a principled manner into the planning framework. Assuming a set of all possible pedestrian intentions in the environment, IAMPs generate a Mixed Observable Markov Decision Process (MOMDP), (a factored variant of Partially Obervable Markov Decision Process (POMDP)) with the human intentions being the unobserved variables. Solving the resulting MOMDP generates a robust pedestrian avoidance policy. In spite of the criticism of POMDPs to be computationally intractable in general, we show that with proper state factorization and latest sampling based approaches the policy can be executed online on a real vehicle on road. We demonstrate this by running the algorithm on a real pedestrian crossing in the NUS campus successfully handling the intentions for multiple pedestrians, even when they are jaywalking. In this paper, we present results in simulation to show the improved performance of the proposed approach over existing methods. Additionally, we present results validating experimentally the assumptions made in formulating the intention aware pedestrian avoidance problem. This work presents a preliminary step towards safer and effective autonomous navigation in urban environments by incorporating the intentions of pedestrians and other drivers on the road.
first_indexed 2024-09-23T14:54:02Z
format Book
id mit-1721.1/129707
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T14:54:02Z
publishDate 2021
publisher Springer International Publishing
record_format dspace
spelling mit-1721.1/1297072022-10-01T23:16:45Z Intention-Aware Pedestrian Avoidance Bandyopadhyay, Tirthankar Jie, Chong Zhuang Hsu, David Ang, Marcelo H. Rus, Daniela L Frazzoli, Emilio Singapore-MIT Alliance in Research and Technology (SMART) Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Laboratory for Information and Decision Systems A critical component of autonomous driving in urban environment is the vehicle’s ability to interact safely and intelligently with the human drivers and on-road pedestrians. This requires identifying the human intentions in real time based on a limited observation history and reacting accordingly. In the context of pedestrian avoidance, traditional approaches like proximity based reactive avoidance, or taking the most likely behavior of the pedestrian into account, often fail to generate a safe and successful avoidance strategy. This is mainly because they fail to take into account the human intention and the inherent uncertainty resulting in identifying such intentions from direct observations. This work formulates the on-road pedestrian avoidance problem as an instance of the Intention-Aware Motion Planning (IAMP) problem, where the human intention uncertainty is incorporated in a principled manner into the planning framework. Assuming a set of all possible pedestrian intentions in the environment, IAMPs generate a Mixed Observable Markov Decision Process (MOMDP), (a factored variant of Partially Obervable Markov Decision Process (POMDP)) with the human intentions being the unobserved variables. Solving the resulting MOMDP generates a robust pedestrian avoidance policy. In spite of the criticism of POMDPs to be computationally intractable in general, we show that with proper state factorization and latest sampling based approaches the policy can be executed online on a real vehicle on road. We demonstrate this by running the algorithm on a real pedestrian crossing in the NUS campus successfully handling the intentions for multiple pedestrians, even when they are jaywalking. In this paper, we present results in simulation to show the improved performance of the proposed approach over existing methods. Additionally, we present results validating experimentally the assumptions made in formulating the intention aware pedestrian avoidance problem. This work presents a preliminary step towards safer and effective autonomous navigation in urban environments by incorporating the intentions of pedestrians and other drivers on the road. 2021-02-08T18:59:19Z 2021-02-08T18:59:19Z 2013 2019-07-16T17:25:19Z Book http://purl.org/eprint/type/ConferencePaper 9783319000640 9783319000657 1610-7438 1610-742X https://hdl.handle.net/1721.1/129707 Bandyopadhyay, Tirthankar et al. "Intention-Aware Pedestrian Avoidance." Experimental Robotics, edited by Jaydev P. Desai et al., Springer International Publishing, 2013, 963-977. © 2013 Springer International Publishing en http://dx.doi.org/10.1007/978-3-319-00065-7_64 Experimental Robotics Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Springer International Publishing MIT web domain
spellingShingle Bandyopadhyay, Tirthankar
Jie, Chong Zhuang
Hsu, David
Ang, Marcelo H.
Rus, Daniela L
Frazzoli, Emilio
Intention-Aware Pedestrian Avoidance
title Intention-Aware Pedestrian Avoidance
title_full Intention-Aware Pedestrian Avoidance
title_fullStr Intention-Aware Pedestrian Avoidance
title_full_unstemmed Intention-Aware Pedestrian Avoidance
title_short Intention-Aware Pedestrian Avoidance
title_sort intention aware pedestrian avoidance
url https://hdl.handle.net/1721.1/129707
work_keys_str_mv AT bandyopadhyaytirthankar intentionawarepedestrianavoidance
AT jiechongzhuang intentionawarepedestrianavoidance
AT hsudavid intentionawarepedestrianavoidance
AT angmarceloh intentionawarepedestrianavoidance
AT rusdanielal intentionawarepedestrianavoidance
AT frazzoliemilio intentionawarepedestrianavoidance