Computationally efficient Gaussian Process changepoint detection and regression
Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2014.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2014
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/90670 |
| _version_ | 1826195238036701184 |
|---|---|
| author | Grande, Robert Conlin |
| author2 | Jonathan P. How. |
| author_facet | Jonathan P. How. Grande, Robert Conlin |
| author_sort | Grande, Robert Conlin |
| collection | MIT |
| description | Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2014. |
| first_indexed | 2024-09-23T10:09:34Z |
| format | Thesis |
| id | mit-1721.1/90670 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T10:09:34Z |
| publishDate | 2014 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/906702019-04-11T11:35:11Z Computationally efficient Gaussian Process changepoint detection and regression Grande, Robert Conlin Jonathan P. How. Massachusetts Institute of Technology. Department of Aeronautics and Astronautics. Massachusetts Institute of Technology. Department of Aeronautics and Astronautics. Aeronautics and Astronautics. Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2014. Cataloged from PDF version of thesis. Includes bibliographical references (pages 150-160). Most existing GP regression algorithms assume a single generative model, leading to poor performance when data are nonstationary, i.e. generated from multiple switching processes. Existing methods for GP regression over non-stationary data include clustering and change-point detection algorithms. However, these methods require significant computation, do not come with provable guarantees on correctness and speed, and most algorithms only work in batch settings. This thesis presents an efficient online GP framework, GP-NBC, that leverages the generalized likelihood ratio test to detect changepoints and learn multiple Gaussian Process models from streaming data. Furthermore, GP-NBC can quickly recognize and reuse previously seen models. The algorithm is shown to be theoretically sample efficient in terms of limiting mistaken predictions. Our empirical results on two real-world datasets and one synthetic dataset show GP-NBC outperforms state of the art methods for nonstationary regression in terms of regression error and computational efficiency. The second part of the thesis introduces a Reinforcement Learning (RL) algorithm, UCRL-GP-CPD, for multi-task Reinforcement Learning when the reward function is nonstationary. First, a novel algorithm UCRL-GP is introduced for stationary reward functions. Then, UCRL-GP is combined with GP-NBC to create UCRL-GP-CPD, which is an algorithm for nonstationary reward functions. Unlike previous work in the literature, UCRL-GP-CPD does not make distributional assumptions about task generation, does not assume changepoint times are known, and does not assume that all tasks have been experienced a priori in a training phase. It is proven that UCRL-GP-CPD is sample efficient in the stationary case, will detect changepoints in the environment with high probability, and is theoretically guaranteed to prevent negative transfer. UCRL-GP-CPD is demonstrated empirically on a variety of simulated and real domains. by Robert Conlin Grande. S.M. 2014-10-08T15:21:42Z 2014-10-08T15:21:42Z 2014 2014 Thesis http://hdl.handle.net/1721.1/90670 890462047 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 160 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Aeronautics and Astronautics. Grande, Robert Conlin Computationally efficient Gaussian Process changepoint detection and regression |
| title | Computationally efficient Gaussian Process changepoint detection and regression |
| title_full | Computationally efficient Gaussian Process changepoint detection and regression |
| title_fullStr | Computationally efficient Gaussian Process changepoint detection and regression |
| title_full_unstemmed | Computationally efficient Gaussian Process changepoint detection and regression |
| title_short | Computationally efficient Gaussian Process changepoint detection and regression |
| title_sort | computationally efficient gaussian process changepoint detection and regression |
| topic | Aeronautics and Astronautics. |
| url | http://hdl.handle.net/1721.1/90670 |
| work_keys_str_mv | AT granderobertconlin computationallyefficientgaussianprocesschangepointdetectionandregression |