Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments

Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2017.

Bibliographic Details
Main Author: Ayton, Benjamin James
Other Authors: Brian C. Williams.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2018
Subjects:
Online Access:http://hdl.handle.net/1721.1/113744
_version_ 1826206966773448704
author Ayton, Benjamin James
author2 Brian C. Williams.
author_facet Brian C. Williams.
Ayton, Benjamin James
author_sort Ayton, Benjamin James
collection MIT
description Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2017.
first_indexed 2024-09-23T13:41:43Z
format Thesis
id mit-1721.1/113744
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T13:41:43Z
publishDate 2018
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1137442019-04-11T10:08:30Z Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments Ayton, Benjamin James Brian C. Williams. Massachusetts Institute of Technology. Department of Aeronautics and Astronautics. Massachusetts Institute of Technology. Department of Aeronautics and Astronautics. Aeronautics and Astronautics. Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2017. Cataloged from PDF version of thesis. Includes bibliographical references (pages 147-150). Exploration of new environments is often conducted in search of some phenomenon of interest. Examples include the search for extreme forms of life in the deep ocean or under the ice on Europa, or localizing resource deposits on the ocean floor. Exploration of all these environments is dangerous because of uncertainty in the environment and poorly characterized disturbances that can damage the exploration vehicle. Autonomous vehicles allows exploration in those environments where it is too dangerous or expensive to send a human-operated craft. Autonomous exploration has been well-studied from the perspective of information maximization, but information gathering has not been considered with the intention of localizing specific phenomena, nor has it been considered in environments where exploration can threaten the vehicle. This thesis addresses both challenges by introducing Risk-Bounded Adaptive Search, which maximizes the number of phenomena located while bounding the probability of mission failure by a user-defined threshold. The first innovation of this thesis is the development of a new information measure that focuses on locating instances of a specific phenomenon. Search for phenomena of interest is framed as a discrete space Markov Decision Process that is solved using forward search and receding horizon planning, with a reward function specified as the information gained about unobserved instances of the phenomenon of interest from measurements. Using this reward function, the number of phenomena located is increased compared to maximizing conventional information, as it steers the agent towards locations where phenomena are thought to exist so they are not bypassed when the belief state is high. The second innovation is a method of applying risk bounds as a function of the expected information gain of a policy over a planning horizon, in contrast to a static bound. This 'Performance-Guided Risk Bounding' system allows an MDP policy to be found that is slightly suboptimal if it has a substantially lower probability of failure, or accept more risk if the reward payoff is large. When applied to information gathering, it allows an autonomous agent to capitalize on high risk and high reward opportunities when they are seen, instead of ignoring them in an effort to conserve risk for the future, when it is ultimately less useful. Since interesting phenomena are often found in risky locations, the ability to take more risk when it is worthwhile results in more phenomena found overall. Finally, a modification to Monte Carlo Tree Search is introduced that implements Performance-Guided Risk Bounding. This allows Risk-Bounded Adaptive Search to be planned in an anytime manner. The output policy is limited to the states that are explored, but risk bounds that scale with the expected information gained over the explored states in the policy are still applied. The resulting policies are shown to converge to the results of forward search, and a few percent differences in phenomena found with an order of magnitude reduction in planning time. by Benjamin James Ayton. S.M. 2018-02-16T20:04:03Z 2018-02-16T20:04:03Z 2017 2017 Thesis http://hdl.handle.net/1721.1/113744 1021852797 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 150 pages application/pdf Massachusetts Institute of Technology
spellingShingle Aeronautics and Astronautics.
Ayton, Benjamin James
Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments
title Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments
title_full Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments
title_fullStr Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments
title_full_unstemmed Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments
title_short Risk-bounded autonomous information gathering for localization of phenomena in hazardous environments
title_sort risk bounded autonomous information gathering for localization of phenomena in hazardous environments
topic Aeronautics and Astronautics.
url http://hdl.handle.net/1721.1/113744
work_keys_str_mv AT aytonbenjaminjames riskboundedautonomousinformationgatheringforlocalizationofphenomenainhazardousenvironments