Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights
Anomaly detection is of paramount importance in many real-world domains characterized by evolving behavior, such as monitoring cyber-physical systems, human conditions and network traffic. Current research in anomaly detection leverages offline learning working with static data or online learning fo...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10473036/ |
| _version_ | 1797243421403906048 |
|---|---|
| author | Kamil Faber Roberto Corizzo Bartlomiej Sniezynski Nathalie Japkowicz |
| author_facet | Kamil Faber Roberto Corizzo Bartlomiej Sniezynski Nathalie Japkowicz |
| author_sort | Kamil Faber |
| collection | DOAJ |
| description | Anomaly detection is of paramount importance in many real-world domains characterized by evolving behavior, such as monitoring cyber-physical systems, human conditions and network traffic. Current research in anomaly detection leverages offline learning working with static data or online learning focusing on constant adaptation to evolving data. At the same time, lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new challenges in dynamic environments while retaining past knowledge. Although this aspect could be beneficial to build effective and robust anomaly detection models, lifelong learning research is mainly dedicated to proposing new model update strategies in image classification and reinforcement learning domains. The limited scope addressed by lifelong learning works thus far creates a gap in understanding whether such techniques and capabilities can be fruitfully exploited in anomaly detection contexts, which represents the main motivation of this paper. More specifically, anomaly detection provides unique challenges, such as an evolving normal class and limited availability of anomalies, which significantly differs from the landscape and scenarios of lifelong image classification and reinforcement learning. In this paper, we face this issue by exploring, motivating, and discussing lifelong anomaly detection, as well as providing foundations with regard to scenarios, strategies, and metrics. First, we explain why lifelong anomaly detection is relevant, defining challenges and opportunities to design anomaly detection methods that deal with lifelong learning complexities. Second, we formulate and characterize lifelong learning settings tailored for anomaly detection problems, and design a scenario generation procedure that enables researchers to experiment with lifelong anomaly detection using existing datasets. Third, we perform experiments with popular anomaly detection methods on proposed lifelong scenarios, emphasizing the gap in performance that could be filled with the adoption of lifelong learning. In summary, our efforts are directed at assessing the performance of non-lifelong anomaly detection models in lifelong scenarios and how the adoption of lifelong learning impacts their learning capabilities. Overall, we conclude that the adoption of lifelong anomaly detection is important to design more robust models that provide a comprehensive view of the environment, as well as simultaneous adaptation and knowledge retention. |
| first_indexed | 2024-04-24T18:54:51Z |
| format | Article |
| id | doaj.art-35de4a0e74404d56a63474116388d2be |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-24T18:54:51Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-35de4a0e74404d56a63474116388d2be2024-03-26T17:44:16ZengIEEEIEEE Access2169-35362024-01-0112413644138010.1109/ACCESS.2024.337769010473036Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and InsightsKamil Faber0https://orcid.org/0000-0003-4221-0017Roberto Corizzo1https://orcid.org/0000-0001-8366-6059Bartlomiej Sniezynski2https://orcid.org/0000-0002-4206-9052Nathalie Japkowicz3https://orcid.org/0000-0003-1176-1617Faculty of Computer Science, AGH University of Science and Technology, Kraków, PolandFaculty of Computer Science, AGH University of Science and Technology, Kraków, PolandFaculty of Computer Science, AGH University of Science and Technology, Kraków, PolandDepartment of Computer Science, American University, Washington, DC, USAAnomaly detection is of paramount importance in many real-world domains characterized by evolving behavior, such as monitoring cyber-physical systems, human conditions and network traffic. Current research in anomaly detection leverages offline learning working with static data or online learning focusing on constant adaptation to evolving data. At the same time, lifelong learning represents an emerging trend, answering the need for machine learning models that continuously adapt to new challenges in dynamic environments while retaining past knowledge. Although this aspect could be beneficial to build effective and robust anomaly detection models, lifelong learning research is mainly dedicated to proposing new model update strategies in image classification and reinforcement learning domains. The limited scope addressed by lifelong learning works thus far creates a gap in understanding whether such techniques and capabilities can be fruitfully exploited in anomaly detection contexts, which represents the main motivation of this paper. More specifically, anomaly detection provides unique challenges, such as an evolving normal class and limited availability of anomalies, which significantly differs from the landscape and scenarios of lifelong image classification and reinforcement learning. In this paper, we face this issue by exploring, motivating, and discussing lifelong anomaly detection, as well as providing foundations with regard to scenarios, strategies, and metrics. First, we explain why lifelong anomaly detection is relevant, defining challenges and opportunities to design anomaly detection methods that deal with lifelong learning complexities. Second, we formulate and characterize lifelong learning settings tailored for anomaly detection problems, and design a scenario generation procedure that enables researchers to experiment with lifelong anomaly detection using existing datasets. Third, we perform experiments with popular anomaly detection methods on proposed lifelong scenarios, emphasizing the gap in performance that could be filled with the adoption of lifelong learning. In summary, our efforts are directed at assessing the performance of non-lifelong anomaly detection models in lifelong scenarios and how the adoption of lifelong learning impacts their learning capabilities. Overall, we conclude that the adoption of lifelong anomaly detection is important to design more robust models that provide a comprehensive view of the environment, as well as simultaneous adaptation and knowledge retention.https://ieeexplore.ieee.org/document/10473036/Lifelong anomaly detectionlifelong learninganomaly detectioncontinual learningcontinual anomaly detection |
| spellingShingle | Kamil Faber Roberto Corizzo Bartlomiej Sniezynski Nathalie Japkowicz Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights IEEE Access Lifelong anomaly detection lifelong learning anomaly detection continual learning continual anomaly detection |
| title | Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights |
| title_full | Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights |
| title_fullStr | Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights |
| title_full_unstemmed | Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights |
| title_short | Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights |
| title_sort | lifelong continual learning for anomaly detection new challenges perspectives and insights |
| topic | Lifelong anomaly detection lifelong learning anomaly detection continual learning continual anomaly detection |
| url | https://ieeexplore.ieee.org/document/10473036/ |
| work_keys_str_mv | AT kamilfaber lifelongcontinuallearningforanomalydetectionnewchallengesperspectivesandinsights AT robertocorizzo lifelongcontinuallearningforanomalydetectionnewchallengesperspectivesandinsights AT bartlomiejsniezynski lifelongcontinuallearningforanomalydetectionnewchallengesperspectivesandinsights AT nathaliejapkowicz lifelongcontinuallearningforanomalydetectionnewchallengesperspectivesandinsights |