Robust learning of probabilistic hybrid models
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2008.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2009
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/46562 |
| _version_ | 1811074438534266880 |
|---|---|
| author | Gil, Stephanie, Ph. D. Massachusetts Institute of Technology |
| author2 | Brian Williams. |
| author_facet | Brian Williams. Gil, Stephanie, Ph. D. Massachusetts Institute of Technology |
| author_sort | Gil, Stephanie, Ph. D. Massachusetts Institute of Technology |
| collection | MIT |
| description | Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2008. |
| first_indexed | 2024-09-23T09:49:28Z |
| format | Thesis |
| id | mit-1721.1/46562 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T09:49:28Z |
| publishDate | 2009 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/465622019-04-12T21:31:16Z Robust learning of probabilistic hybrid models Gil, Stephanie, Ph. D. Massachusetts Institute of Technology Brian Williams. Massachusetts Institute of Technology. Dept. of Aeronautics and Astronautics. Massachusetts Institute of Technology. Dept. of Aeronautics and Astronautics. Aeronautics and Astronautics. Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2008. Includes bibliographical references (p. 125-127). Advances in autonomy, in the fields of control, estimation, and diagnosis, have improved immensely, as seen by spacecraft that navigate toward pinpoint landings, or speech recognition enabled in hand-held devices. Arguably the most important step to controlling and improving a system, is to understand that system. For this reason, accurate models are essential for continued advancements in the field of autonomy. Hybrid stochastic models, such as JMLS and LPHA, allow for representational accuracy of a general scope of problems. The goal of this thesis is to develop a robust method for learning accurate hybrid models automatically from data. A robust method should learn a set of model parameters, but should also avoid convergence to locally optimal solutions that reduce accuracy, and should be less sensitive to sparse or poor quality observation data. These three goals are the focus of this thesis. We present the HML-LPHA algorithm that uses approximate EM for learning maximum likelihood model parameters of LPHA, given a sequence of control inputs {u}0T, and outputs, {y}T+I 1 We implement the algorithm in a scenario that simulates the mechanical wheel failure of the MER Spirit rover wheel and demonstrate empirical convergence of the algorithm. Local convergence is a limitation of many optimization approaches for multimodal functions, including EM. For model learning, this can mean a severe compromise in accuracy. We present the kMeans-EM algorithm, that iteratively learns the locations and shapes of explored local maxima of our model likelihood function, and focuses the search away from these areas of the solution space toward undiscovered maxima that are promising apriori. We find the kMeans-EM algorithm demonstrates iteratively increasing improvement over a Random Restarts method with respect to learning sets of model parameters with higher likelihood values, and reducing Euclidean distance to the true set of model parameters. Lastly, the AHML-LPHA algorithm is an active hybrid model learning approach that augments sparse, and/or very noisy training data, with limited queries of the discrete state. (cont.) We use an active approach for adding data to our training set, where we query at points that obtain the greatest reduction in uncertainty of the distribution over the hybrid state trajectories. Empirical evidence indicates that querying only 6% of the time reduces continous state squared error and MAP mode estimate error of the discrete state. We also find that when the passive learner, HML-LPHA, diverges due to poor initialization or training data, the AHML-LPHA algorithm is capable of convergence; at times, just one query allows for convergence, demonstrating a vast improvement in learning capacity with a very limited amount of data augmentation. by Stephanie Gil. S.M. 2009-08-26T16:51:45Z 2009-08-26T16:51:45Z 2008 2008 Thesis http://hdl.handle.net/1721.1/46562 420344373 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 127 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Aeronautics and Astronautics. Gil, Stephanie, Ph. D. Massachusetts Institute of Technology Robust learning of probabilistic hybrid models |
| title | Robust learning of probabilistic hybrid models |
| title_full | Robust learning of probabilistic hybrid models |
| title_fullStr | Robust learning of probabilistic hybrid models |
| title_full_unstemmed | Robust learning of probabilistic hybrid models |
| title_short | Robust learning of probabilistic hybrid models |
| title_sort | robust learning of probabilistic hybrid models |
| topic | Aeronautics and Astronautics. |
| url | http://hdl.handle.net/1721.1/46562 |
| work_keys_str_mv | AT gilstephaniephdmassachusettsinstituteoftechnology robustlearningofprobabilistichybridmodels |