An extended Kalman filter extension of the augmented Markov decision process
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2005.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2006
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/32453 |
| _version_ | 1811089189567987712 |
|---|---|
| author | Lommel, Peter Hans |
| author2 | Nicholas Roy and Marc W. McConley. |
| author_facet | Nicholas Roy and Marc W. McConley. Lommel, Peter Hans |
| author_sort | Lommel, Peter Hans |
| collection | MIT |
| description | Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2005. |
| first_indexed | 2024-09-23T14:15:14Z |
| format | Thesis |
| id | mit-1721.1/32453 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T14:15:14Z |
| publishDate | 2006 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/324532019-04-12T21:48:33Z An extended Kalman filter extension of the augmented Markov decision process Lommel, Peter Hans Nicholas Roy and Marc W. McConley. Massachusetts Institute of Technology. Dept. of Aeronautics and Astronautics. Massachusetts Institute of Technology. Dept. of Aeronautics and Astronautics. Aeronautics and Astronautics. Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2005. Includes bibliographical references (p. 99-102). As the field of robotics continues to mature, individual robots are increasingly capable of performing multiple complex tasks. As a result, the ability for robots to move autonomously through their environments is a fundamental necessity. If perfect knowledge of the robot's position is available, the robot motion planning problem can be solved efficiently using any of a number of existing algorithms. Frequently though, the robot's position can only be estimated using incomplete and imperfect information from its sensors and an approximate model of its dynamics. Algorithms which assume perfect knowledge of the robot's position can still be applied by treating the mean or maximum likelihood estimate of the robot's position as certain. However, unless the uncertainty in the agent's position is very small, this approach is not reliable. In order to perform optimally in this situation, planners, such as the partially observable Markov decision process, plan over the entire set of beliefs (distributions over the robot's position). Unfortunately, this approach is only tractable for problems with very few states. Between these two extreme approaches, however, lies a continuum of possible planners which plan over a subset of the belief space. The difficulty that these planners face is choosing and representing a minimal subset of the belief space which spans the set of beliefs that the robot will actually experience. In this paper, we show that there exists a very natural such set, the set, of Gaussian beliefs. By combining an extended Kalman filter with an augmented Markov decision process, we create a path planner which efficiently plans over a discrete approximation of the set of Gaussian beliefs. (cont.) The resulting planner is demonstrated via simulation to be both computationally tractable and robust to uncertainty in the robot's position. by Peter Hans Lommel. S.M. 2006-03-29T18:45:55Z 2006-03-29T18:45:55Z 2005 2005 Thesis http://hdl.handle.net/1721.1/32453 61749724 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 108 p. 4499047 bytes 4505024 bytes application/pdf application/pdf application/pdf Massachusetts Institute of Technology |
| spellingShingle | Aeronautics and Astronautics. Lommel, Peter Hans An extended Kalman filter extension of the augmented Markov decision process |
| title | An extended Kalman filter extension of the augmented Markov decision process |
| title_full | An extended Kalman filter extension of the augmented Markov decision process |
| title_fullStr | An extended Kalman filter extension of the augmented Markov decision process |
| title_full_unstemmed | An extended Kalman filter extension of the augmented Markov decision process |
| title_short | An extended Kalman filter extension of the augmented Markov decision process |
| title_sort | extended kalman filter extension of the augmented markov decision process |
| topic | Aeronautics and Astronautics. |
| url | http://hdl.handle.net/1721.1/32453 |
| work_keys_str_mv | AT lommelpeterhans anextendedkalmanfilterextensionoftheaugmentedmarkovdecisionprocess AT lommelpeterhans extendedkalmanfilterextensionoftheaugmentedmarkovdecisionprocess |