Robust, Goal-directed Plan Execution with Bounded Risk

PhD thesis

Bibliographic Details
Main Author: Ono, Masahiro
Other Authors: Brian Williams
Published: 2018
Online Access:http://hdl.handle.net/1721.1/113369
_version_ 1811074196530266112
author Ono, Masahiro
author2 Brian Williams
author_facet Brian Williams
Ono, Masahiro
author_sort Ono, Masahiro
collection MIT
description PhD thesis
first_indexed 2024-09-23T09:45:28Z
id mit-1721.1/113369
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T09:45:28Z
publishDate 2018
record_format dspace
spelling mit-1721.1/1133692019-04-12T23:19:39Z Robust, Goal-directed Plan Execution with Bounded Risk Ono, Masahiro Brian Williams Model-based Embedded and Robotic Systems Brian Williams Model-based Embedded and Robotic Systems PhD thesis There is an increasing need for robust optimal plan execution for multi-agent systems in uncertain environments, while guaranteeing an acceptable probability of success. For ex- ample, a fleet of unmanned aerial vehicles (UAVs) and autonomous underwater vehicles (AUVs) are required to operate autonomously for an extensive mission duration in an uncertain environment. Previous work introduced the concept of a model-based executive, which increases the level of autonomy, elevating the level at which systems are commanded. This thesis develops model-based executives that reason explicitly from a stochastic plant model to find the optimal course of action, while ensuring that the probability of failure is within a user-specified risk bound. This thesis presents two robust mode-based executives: probabilisticSulu orp-Sulu, and distributedprobabilisticSulu or dp-Sulu. The objective for p-Sulu and dp-Sulu is to allow users to command continuous, stochastic multi-agent systems in a manner that is both intuitive and safe. The user specifies the desired evolution of the plant state, as well as the acceptable probabilities of failure, as a temporal plan on states called a chance-constrained qualitative state plan (CCQSP). An example of a CCQSP statement is "go to A through B within 30 minutes, with less than 0.001% probability of failure." p-Sulu and dp-Sulu take a CCQSP, a continuous plant model with stochastic uncertainty, and an objective function as inputs, and outputs an optimal continuous control sequence, as well as an optimal discrete schedule. The difference between p-Sulu and dp-Sulu is that p-Sulu plans in a centralized manner while dp-Sulu plans in a distributed manner. dp-Sulu enables robust CCQSP execution for multi-agent systems. We solve the problem based on the key concept of risk allocation, which achieves tractability by allocating the specified risk to individual constraints and mapping the result into an equivalent deterministic constrained optimization problem. Risk allocation also enables a distributed plan execution for multi-agent systems by distributing the risk among agents to decompose the optimization problem. Building upon the risk allocation approach, we develop our first CCQSP executive, p-Sulu, in four spirals. First, we develop the Convex Risk Allocation (CRA) algorithm, which can solve a CCQSP planning problem with a convex state space and a fixed schedule, highlighting the capability of optimally allocating risk to individual constraints. Second, we develop the Non-convex Iterative Risk Allocation (NIRA) algorithm, which can handle non-convex state space. Third, we build upon NIRA a full-horizon CCQSP planner, p-Sulu FH, which can optimize not only the control sequence but also the schedule. Fourth, we develop p-Sulu, which enables the real-time execution of CCQSPs by employing the receding horizon approach. Our second CCQSP executive, dp-Sulu, is developed in two spirals. First, we develop the Market-based Iterative Risk Allocation (MIRA) algorithm, which can control a multi-agent system in a distributed manner by optimally distributing risk among agents through the market-based method called tatonnement. Second and finally, we integrate the capability of MIRA into p-Sulu to build the robust model-based executive, dp-Sulu, which can execute CCQSPs on multi-agent systems in a distributed manner. Our simulation results demonstrate that our executives can efficiently execute CCQSP planning problems with significantly reduced suboptimality compared to prior art. 2018-01-31T00:01:14Z 2018-01-31T00:01:14Z 2012-02-02 2018-01-31T00:01:14Z http://hdl.handle.net/1721.1/113369 MIT-CSAIL-TR-2018-009 Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ 283 p. application/pdf
spellingShingle Ono, Masahiro
Robust, Goal-directed Plan Execution with Bounded Risk
title Robust, Goal-directed Plan Execution with Bounded Risk
title_full Robust, Goal-directed Plan Execution with Bounded Risk
title_fullStr Robust, Goal-directed Plan Execution with Bounded Risk
title_full_unstemmed Robust, Goal-directed Plan Execution with Bounded Risk
title_short Robust, Goal-directed Plan Execution with Bounded Risk
title_sort robust goal directed plan execution with bounded risk
url http://hdl.handle.net/1721.1/113369
work_keys_str_mv AT onomasahiro robustgoaldirectedplanexecutionwithboundedrisk