Perception-aware planning for differentially flat robots

The central question to this thesis can be stated as follows: “Can we design computationally efficient algorithms that are capable of robustly navigating complex environments and unstructured environments at operational speeds." Visual inertial navigation in perceptually degraded environments i...

Full description

Bibliographic Details
Main Author: Murali, Varun
Other Authors: Karaman, Sertac
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/153794
_version_ 1811082255249965056
author Murali, Varun
author2 Karaman, Sertac
author_facet Karaman, Sertac
Murali, Varun
author_sort Murali, Varun
collection MIT
description The central question to this thesis can be stated as follows: “Can we design computationally efficient algorithms that are capable of robustly navigating complex environments and unstructured environments at operational speeds." Visual inertial navigation in perceptually degraded environments is a challenging problem for robotic vehicles. With a camera, inertial measurement unit (IMU) pairing being ubiquitous to most consumer electronics, they form an ideal pairing for applications on the edge and have found applications ranging from large-scale search and rescue, autonomous driving to home robots such as robotic vacuum cleaners. In general, the navigation problem for robots can be written in the form of the sense-think-act framework for autonomy. The “sensing" part is typically performed in this context as bearing measurements to visually salient locations in the environment; the “planning" part then uses the estimate of the ego-state from the sensors and produces a (compactly represented) trajectory from the current location to the goal. Finally, the “act" or controller follows the plan. This division leaves several interesting problems at the intersection of the parts of the framework. For instance, consider the problem of navigating in a relatively unknown environment; if the future percepts are not carefully planned, it is possible to enter a room with very few visual features that degrade the quality of state estimation, which in turn can result in poor closed-loop performance. Quadrotors are a class of robots that dictate further constraints on their sensors, namely size and weight. These constraints make camera-IMU pairings ideal for this type of aerial vehicle and bring further interesting challenges in terms of computational load for embedded systems. To this end, we first study the problem of modeling visibility on the camera canvas and incorporating these heuristics as an optimal-control problem. We then study the problem of optimizing the robot speed along the path with visible features such that the traversal time is minimized and the constraints are satisfied. As we hit the limit of optimization capability in a model-based fashion, we employ machine learning to jointly optimize the speed, uncertainty along the trajectory in a numerically stable fashion.
first_indexed 2024-09-23T12:00:11Z
format Thesis
id mit-1721.1/153794
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T12:00:11Z
publishDate 2024
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1537942024-03-16T03:37:32Z Perception-aware planning for differentially flat robots Murali, Varun Karaman, Sertac Massachusetts Institute of Technology. Department of Aeronautics and Astronautics The central question to this thesis can be stated as follows: “Can we design computationally efficient algorithms that are capable of robustly navigating complex environments and unstructured environments at operational speeds." Visual inertial navigation in perceptually degraded environments is a challenging problem for robotic vehicles. With a camera, inertial measurement unit (IMU) pairing being ubiquitous to most consumer electronics, they form an ideal pairing for applications on the edge and have found applications ranging from large-scale search and rescue, autonomous driving to home robots such as robotic vacuum cleaners. In general, the navigation problem for robots can be written in the form of the sense-think-act framework for autonomy. The “sensing" part is typically performed in this context as bearing measurements to visually salient locations in the environment; the “planning" part then uses the estimate of the ego-state from the sensors and produces a (compactly represented) trajectory from the current location to the goal. Finally, the “act" or controller follows the plan. This division leaves several interesting problems at the intersection of the parts of the framework. For instance, consider the problem of navigating in a relatively unknown environment; if the future percepts are not carefully planned, it is possible to enter a room with very few visual features that degrade the quality of state estimation, which in turn can result in poor closed-loop performance. Quadrotors are a class of robots that dictate further constraints on their sensors, namely size and weight. These constraints make camera-IMU pairings ideal for this type of aerial vehicle and bring further interesting challenges in terms of computational load for embedded systems. To this end, we first study the problem of modeling visibility on the camera canvas and incorporating these heuristics as an optimal-control problem. We then study the problem of optimizing the robot speed along the path with visible features such that the traversal time is minimized and the constraints are satisfied. As we hit the limit of optimization capability in a model-based fashion, we employ machine learning to jointly optimize the speed, uncertainty along the trajectory in a numerically stable fashion. Ph.D. 2024-03-15T19:24:29Z 2024-03-15T19:24:29Z 2024-02 2024-02-16T20:56:17.810Z Thesis https://hdl.handle.net/1721.1/153794 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Murali, Varun
Perception-aware planning for differentially flat robots
title Perception-aware planning for differentially flat robots
title_full Perception-aware planning for differentially flat robots
title_fullStr Perception-aware planning for differentially flat robots
title_full_unstemmed Perception-aware planning for differentially flat robots
title_short Perception-aware planning for differentially flat robots
title_sort perception aware planning for differentially flat robots
url https://hdl.handle.net/1721.1/153794
work_keys_str_mv AT muralivarun perceptionawareplanningfordifferentiallyflatrobots