Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors
Anomaly detection on time series data is increasingly common across various industrial domains that require monitoring metrics to prevent potential accidents and economic losses. The complications of anomaly detection revolve around a scarcity of labeled data and the need to learn temporal correlati...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/144671 |
| _version_ | 1811097154987491328 |
|---|---|
| author | Wong, Lawrence C. |
| author2 | Veeramachaneni, Kalyan |
| author_facet | Veeramachaneni, Kalyan Wong, Lawrence C. |
| author_sort | Wong, Lawrence C. |
| collection | MIT |
| description | Anomaly detection on time series data is increasingly common across various industrial domains that require monitoring metrics to prevent potential accidents and economic losses. The complications of anomaly detection revolve around a scarcity of labeled data and the need to learn temporal correlations between multiple variables. Most successful unsupervised methods either use single-timestamp prediction or reconstruct entire time series. However, these methods are not mutually exclusive and can each offer complementary perspectives. This work first explores the successes and limitations of prediction-based and reconstruction-based methods. Next, it compares the effect of attention-based architectures with LSTM-based architectures on existing models. Finally, this research proposes a novel autoencoder architecture capable of producing bi-directional predictions while simultaneously reconstructing the original time series by optimizing a joint objective function. An ablation study using a mixture of prediction and reconstruction errors demonstrates that this simple architecture outperforms other state-of-the-art models for anomaly detection on both univariate and multivariate time series. |
| first_indexed | 2024-09-23T16:55:13Z |
| format | Thesis |
| id | mit-1721.1/144671 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T16:55:13Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1446712022-08-30T03:01:54Z Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors Wong, Lawrence C. Veeramachaneni, Kalyan Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Anomaly detection on time series data is increasingly common across various industrial domains that require monitoring metrics to prevent potential accidents and economic losses. The complications of anomaly detection revolve around a scarcity of labeled data and the need to learn temporal correlations between multiple variables. Most successful unsupervised methods either use single-timestamp prediction or reconstruct entire time series. However, these methods are not mutually exclusive and can each offer complementary perspectives. This work first explores the successes and limitations of prediction-based and reconstruction-based methods. Next, it compares the effect of attention-based architectures with LSTM-based architectures on existing models. Finally, this research proposes a novel autoencoder architecture capable of producing bi-directional predictions while simultaneously reconstructing the original time series by optimizing a joint objective function. An ablation study using a mixture of prediction and reconstruction errors demonstrates that this simple architecture outperforms other state-of-the-art models for anomaly detection on both univariate and multivariate time series. M.Eng. 2022-08-29T16:03:41Z 2022-08-29T16:03:41Z 2022-05 2022-05-27T16:19:10.928Z Thesis https://hdl.handle.net/1721.1/144671 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Wong, Lawrence C. Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors |
| title | Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors |
| title_full | Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors |
| title_fullStr | Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors |
| title_full_unstemmed | Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors |
| title_short | Time Series Anomaly Detection using Prediction-Reconstruction Mixture Errors |
| title_sort | time series anomaly detection using prediction reconstruction mixture errors |
| url | https://hdl.handle.net/1721.1/144671 |
| work_keys_str_mv | AT wonglawrencec timeseriesanomalydetectionusingpredictionreconstructionmixtureerrors |