Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems
Learning-Enabled Components (LECs), such as neural networks, are broadly employed in Cyber-Physical Systems (CPSs) to tackle a wide variety of complex tasks in high-uncertainty environments. However, the training dataset is inevitably incomplete, and Out-Of-Distribution (OOD) data not encountered du...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2022-12-01
|
| Series: | Applied Artificial Intelligence |
| Online Access: | http://dx.doi.org/10.1080/08839514.2022.2131056 |
| _version_ | 1797641088087883776 |
|---|---|
| author | Feiyang Cai Ali I. Ozdagli Xenofon Koutsoukos |
| author_facet | Feiyang Cai Ali I. Ozdagli Xenofon Koutsoukos |
| author_sort | Feiyang Cai |
| collection | DOAJ |
| description | Learning-Enabled Components (LECs), such as neural networks, are broadly employed in Cyber-Physical Systems (CPSs) to tackle a wide variety of complex tasks in high-uncertainty environments. However, the training dataset is inevitably incomplete, and Out-Of-Distribution (OOD) data not encountered during the LEC training may lead to erroneous predictions, jeopardizing the safety of the system. In this paper, we first analyze the causes of OOD data and define various types of OOD data in learning-enabled CPSs. We propose an approach to effectively detect OOD data for both classification and regression problems. The proposed approach incorporates the variational autoencoder for classification and regression model to the Inductive Conformal Anomaly Detection (ICAD) framework, enabling the detection algorithm to take into consideration not only the LEC inputs but also the LEC outputs. We evaluate the approach using extensive experiments for both classification and regression tasks, and the experimental results validate the effectiveness of the proposed method for detecting different types of OOD data. Furthermore, the execution time of detection is relatively short; therefore, the proposed approach can be used for real-time detection. |
| first_indexed | 2024-03-11T13:40:30Z |
| format | Article |
| id | doaj.art-8e9d8ee5e9bf4d44b316d8d91c578f70 |
| institution | Directory Open Access Journal |
| issn | 0883-9514 1087-6545 |
| language | English |
| last_indexed | 2024-03-11T13:40:30Z |
| publishDate | 2022-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Applied Artificial Intelligence |
| spelling | doaj.art-8e9d8ee5e9bf4d44b316d8d91c578f702023-11-02T13:36:38ZengTaylor & Francis GroupApplied Artificial Intelligence0883-95141087-65452022-12-0136110.1080/08839514.2022.21310562131056Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical SystemsFeiyang Cai0Ali I. Ozdagli1Xenofon Koutsoukos2Vanderbilt UniversityVanderbilt UniversityVanderbilt UniversityLearning-Enabled Components (LECs), such as neural networks, are broadly employed in Cyber-Physical Systems (CPSs) to tackle a wide variety of complex tasks in high-uncertainty environments. However, the training dataset is inevitably incomplete, and Out-Of-Distribution (OOD) data not encountered during the LEC training may lead to erroneous predictions, jeopardizing the safety of the system. In this paper, we first analyze the causes of OOD data and define various types of OOD data in learning-enabled CPSs. We propose an approach to effectively detect OOD data for both classification and regression problems. The proposed approach incorporates the variational autoencoder for classification and regression model to the Inductive Conformal Anomaly Detection (ICAD) framework, enabling the detection algorithm to take into consideration not only the LEC inputs but also the LEC outputs. We evaluate the approach using extensive experiments for both classification and regression tasks, and the experimental results validate the effectiveness of the proposed method for detecting different types of OOD data. Furthermore, the execution time of detection is relatively short; therefore, the proposed approach can be used for real-time detection.http://dx.doi.org/10.1080/08839514.2022.2131056 |
| spellingShingle | Feiyang Cai Ali I. Ozdagli Xenofon Koutsoukos Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems Applied Artificial Intelligence |
| title | Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems |
| title_full | Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems |
| title_fullStr | Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems |
| title_full_unstemmed | Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems |
| title_short | Variational Autoencoder for Classification and Regression for Out-of-Distribution Detection in Learning-Enabled Cyber-Physical Systems |
| title_sort | variational autoencoder for classification and regression for out of distribution detection in learning enabled cyber physical systems |
| url | http://dx.doi.org/10.1080/08839514.2022.2131056 |
| work_keys_str_mv | AT feiyangcai variationalautoencoderforclassificationandregressionforoutofdistributiondetectioninlearningenabledcyberphysicalsystems AT aliiozdagli variationalautoencoderforclassificationandregressionforoutofdistributiondetectioninlearningenabledcyberphysicalsystems AT xenofonkoutsoukos variationalautoencoderforclassificationandregressionforoutofdistributiondetectioninlearningenabledcyberphysicalsystems |