Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder
The modern National Airspace System (NAS) is an extremely safe system and the aviation industry has experienced a steady decrease in fatalities over the years. This is in part due the airlines, manufacturers, FAA, and research institutions all continually working to improve the safety of the operati...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-08-01
|
| Series: | Aerospace |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2226-4310/7/8/115 |
| _version_ | 1827710956361220096 |
|---|---|
| author | Milad Memarzadeh Bryan Matthews Ilya Avrekh |
| author_facet | Milad Memarzadeh Bryan Matthews Ilya Avrekh |
| author_sort | Milad Memarzadeh |
| collection | DOAJ |
| description | The modern National Airspace System (NAS) is an extremely safe system and the aviation industry has experienced a steady decrease in fatalities over the years. This is in part due the airlines, manufacturers, FAA, and research institutions all continually working to improve the safety of the operations. However, the current approach for identifying vulnerabilities in NAS operations leverages domain expertise using knowledge about how the system should behave within the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to assess risk based on pre-defined safety vulnerabilities. Moreover, state-of-the-art machine learning models that are developed for event detection in aerospace data usually rely on supervised learning. However, in many real-world problems, such as flight safety, creating labels for the data requires specialized expertise that is time consuming and therefore largely impractical. To address this challenge, we develop a Convolutional Variational Auto-Encoder (CVAE), an unsupervised deep generative model for anomaly detection in high-dimensional time-series data. Validating on Yahoo’s benchmark data as well as a case study of identifying anomalies in commercial flights’ take-offs, we show that CVAE outperforms both classic and deep learning-based approaches in precision and recall of detecting anomalies. |
| first_indexed | 2024-03-10T17:47:05Z |
| format | Article |
| id | doaj.art-a15f93d9414d42b8852bd52baec68bba |
| institution | Directory Open Access Journal |
| issn | 2226-4310 |
| language | English |
| last_indexed | 2024-03-10T17:47:05Z |
| publishDate | 2020-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Aerospace |
| spelling | doaj.art-a15f93d9414d42b8852bd52baec68bba2023-11-20T09:30:17ZengMDPI AGAerospace2226-43102020-08-017811510.3390/aerospace7080115Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-EncoderMilad Memarzadeh0Bryan Matthews1Ilya Avrekh2Data Sciences Group, NASA Ames Research Center, USRA, Moffett Field, CA 94035, USAData Sciences Group, NASA Ames Research Center, KBR Inc., Moffett Field, CA 94035, USAData Sciences Group, NASA Ames Research Center, KBR Inc., Moffett Field, CA 94035, USAThe modern National Airspace System (NAS) is an extremely safe system and the aviation industry has experienced a steady decrease in fatalities over the years. This is in part due the airlines, manufacturers, FAA, and research institutions all continually working to improve the safety of the operations. However, the current approach for identifying vulnerabilities in NAS operations leverages domain expertise using knowledge about how the system should behave within the expected tolerances to known safety margins. This approach works well when the system has a well-defined operating condition. However, the operations in the NAS can be highly complex with various nuances that render it difficult to assess risk based on pre-defined safety vulnerabilities. Moreover, state-of-the-art machine learning models that are developed for event detection in aerospace data usually rely on supervised learning. However, in many real-world problems, such as flight safety, creating labels for the data requires specialized expertise that is time consuming and therefore largely impractical. To address this challenge, we develop a Convolutional Variational Auto-Encoder (CVAE), an unsupervised deep generative model for anomaly detection in high-dimensional time-series data. Validating on Yahoo’s benchmark data as well as a case study of identifying anomalies in commercial flights’ take-offs, we show that CVAE outperforms both classic and deep learning-based approaches in precision and recall of detecting anomalies.https://www.mdpi.com/2226-4310/7/8/115anomaly detectionvariational autoencoderflight safetytime series |
| spellingShingle | Milad Memarzadeh Bryan Matthews Ilya Avrekh Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder Aerospace anomaly detection variational autoencoder flight safety time series |
| title | Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder |
| title_full | Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder |
| title_fullStr | Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder |
| title_full_unstemmed | Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder |
| title_short | Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder |
| title_sort | unsupervised anomaly detection in flight data using convolutional variational auto encoder |
| topic | anomaly detection variational autoencoder flight safety time series |
| url | https://www.mdpi.com/2226-4310/7/8/115 |
| work_keys_str_mv | AT miladmemarzadeh unsupervisedanomalydetectioninflightdatausingconvolutionalvariationalautoencoder AT bryanmatthews unsupervisedanomalydetectioninflightdatausingconvolutionalvariationalautoencoder AT ilyaavrekh unsupervisedanomalydetectioninflightdatausingconvolutionalvariationalautoencoder |