Adjusting for Autocorrelated Errors in Neural Networks for Time Series
Time series are everywhere and exist in a wide range of domains. Electrical activities of manufacturing equipment, electrocardiograms, traffic occupancy rates, currency exchange rates, speech signals, and atmospheric measurements can all be seen as examples of time series. Modeling time series acros...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/139516 |
| _version_ | 1826195883895554048 |
|---|---|
| author | Sun, Fan-Keng |
| author2 | Boning, Duane S. |
| author_facet | Boning, Duane S. Sun, Fan-Keng |
| author_sort | Sun, Fan-Keng |
| collection | MIT |
| description | Time series are everywhere and exist in a wide range of domains. Electrical activities of manufacturing equipment, electrocardiograms, traffic occupancy rates, currency exchange rates, speech signals, and atmospheric measurements can all be seen as examples of time series. Modeling time series across different domains is difficult. In many cases, it requires enormous effort and a significant amount of prior knowledge to generate highly accurate models tailored to a particular time series domain. In response, an increasing body of research focuses on training neural networks on time series, such that the neural networks learn to model the time series. A common assumption in training neural networks on time series is that the errors at different time steps are uncorrelated. However, due to the temporality of the data, errors are actually autocorrelated in many cases, making the assumption inaccurate.
In this thesis, we propose to learn the autocorrelation coefficient jointly with the model parameters in order to adjust for autocorrelated errors and thus improve model performances on time series. We first develop our method for time series regression. Then, extensions are made to three other time series tasks: time series forecasting, time series classification, and anomaly detection. Large-scale experiments with various neural network architectures and datasets from the four time series tasks verify the effectiveness of our method. Results show that our method enhances performance across most of these time series modeling tasks. |
| first_indexed | 2024-09-23T10:17:16Z |
| format | Thesis |
| id | mit-1721.1/139516 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T10:17:16Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1395162022-01-15T03:52:13Z Adjusting for Autocorrelated Errors in Neural Networks for Time Series Sun, Fan-Keng Boning, Duane S. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Time series are everywhere and exist in a wide range of domains. Electrical activities of manufacturing equipment, electrocardiograms, traffic occupancy rates, currency exchange rates, speech signals, and atmospheric measurements can all be seen as examples of time series. Modeling time series across different domains is difficult. In many cases, it requires enormous effort and a significant amount of prior knowledge to generate highly accurate models tailored to a particular time series domain. In response, an increasing body of research focuses on training neural networks on time series, such that the neural networks learn to model the time series. A common assumption in training neural networks on time series is that the errors at different time steps are uncorrelated. However, due to the temporality of the data, errors are actually autocorrelated in many cases, making the assumption inaccurate. In this thesis, we propose to learn the autocorrelation coefficient jointly with the model parameters in order to adjust for autocorrelated errors and thus improve model performances on time series. We first develop our method for time series regression. Then, extensions are made to three other time series tasks: time series forecasting, time series classification, and anomaly detection. Large-scale experiments with various neural network architectures and datasets from the four time series tasks verify the effectiveness of our method. Results show that our method enhances performance across most of these time series modeling tasks. S.M. 2022-01-14T15:17:03Z 2022-01-14T15:17:03Z 2021-06 2021-06-24T19:41:08.780Z Thesis https://hdl.handle.net/1721.1/139516 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Sun, Fan-Keng Adjusting for Autocorrelated Errors in Neural Networks for Time Series |
| title | Adjusting for Autocorrelated Errors in Neural Networks for Time Series |
| title_full | Adjusting for Autocorrelated Errors in Neural Networks for Time Series |
| title_fullStr | Adjusting for Autocorrelated Errors in Neural Networks for Time Series |
| title_full_unstemmed | Adjusting for Autocorrelated Errors in Neural Networks for Time Series |
| title_short | Adjusting for Autocorrelated Errors in Neural Networks for Time Series |
| title_sort | adjusting for autocorrelated errors in neural networks for time series |
| url | https://hdl.handle.net/1721.1/139516 |
| work_keys_str_mv | AT sunfankeng adjustingforautocorrelatederrorsinneuralnetworksfortimeseries |