Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities

The application of Artificial Intelligence (AI) and Machine Learning (ML) to cybersecurity challenges has gained traction in industry and academia, partially as a result of widespread malware attacks on critical systems such as cloud infrastructures and government institutions. Intrusion Detection S...

Full description

Bibliographic Details
Main Authors: Subash Neupane, Jesse Ables, William Anderson, Sudip Mittal, Shahram Rahimi, Ioana Banicescu, Maria Seale
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9927396/
_version_ 1811194229283618816
author Subash Neupane
Jesse Ables
William Anderson
Sudip Mittal
Shahram Rahimi
Ioana Banicescu
Maria Seale
author_facet Subash Neupane
Jesse Ables
William Anderson
Sudip Mittal
Shahram Rahimi
Ioana Banicescu
Maria Seale
author_sort Subash Neupane
collection DOAJ
description The application of Artificial Intelligence (AI) and Machine Learning (ML) to cybersecurity challenges has gained traction in industry and academia, partially as a result of widespread malware attacks on critical systems such as cloud infrastructures and government institutions. Intrusion Detection Systems (IDS), using some forms of AI, have received widespread adoption due to their ability to handle vast amounts of data with a high prediction accuracy. These systems are hosted in the organizational Cyber Security Operation Center (CSoC) as a defense tool to monitor and detect malicious network flow that would otherwise impact the Confidentiality, Integrity, and Availability (CIA). CSoC analysts rely on these systems to make decisions about the detected threats. However, IDSs designed using Deep Learning (DL) techniques are often treated as black box models and do not provide a justification for their predictions. This creates a barrier for CSoC analysts, as they are unable to improve their decisions based on the model’s predictions. One solution to this problem is to design explainable IDS (X-IDS). This survey reviews the state-of-the-art in explainable AI (XAI) for IDS, its current challenges, and discusses how these challenges span to the design of an X-IDS. In particular, we discuss black box and white box approaches comprehensively. We also present the tradeoff between these approaches in terms of their performance and ability to produce explanations. Furthermore, we propose a generic architecture that considers human-in-the-loop which can be used as a guideline when designing an X-IDS. Research recommendations are given from three critical viewpoints: the need to define explainability for IDS, the need to create explanations tailored to various stakeholders, and the need to design metrics to evaluate explanations.
first_indexed 2024-04-12T00:22:26Z
format Article
id doaj.art-a078bddcabed4eee81d1290dfad1622c
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-12T00:22:26Z
publishDate 2022-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-a078bddcabed4eee81d1290dfad1622c2022-12-22T03:55:41ZengIEEEIEEE Access2169-35362022-01-011011239211241510.1109/ACCESS.2022.32166179927396Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and OpportunitiesSubash Neupane0https://orcid.org/0000-0001-9260-3914Jesse Ables1William Anderson2Sudip Mittal3https://orcid.org/0000-0001-9151-8347Shahram Rahimi4Ioana Banicescu5https://orcid.org/0000-0001-5206-1436Maria Seale6Department of Computer Science and Engineering, Mississippi State University, Mississippi, MS, USADepartment of Computer Science and Engineering, Mississippi State University, Mississippi, MS, USADepartment of Computer Science and Engineering, Mississippi State University, Mississippi, MS, USADepartment of Computer Science and Engineering, Mississippi State University, Mississippi, MS, USADepartment of Computer Science and Engineering, Mississippi State University, Mississippi, MS, USADepartment of Computer Science and Engineering, Mississippi State University, Mississippi, MS, USAU.S. Army Engineer Research and Development Center, Vicksburg, Mississippi, MS, USAThe application of Artificial Intelligence (AI) and Machine Learning (ML) to cybersecurity challenges has gained traction in industry and academia, partially as a result of widespread malware attacks on critical systems such as cloud infrastructures and government institutions. Intrusion Detection Systems (IDS), using some forms of AI, have received widespread adoption due to their ability to handle vast amounts of data with a high prediction accuracy. These systems are hosted in the organizational Cyber Security Operation Center (CSoC) as a defense tool to monitor and detect malicious network flow that would otherwise impact the Confidentiality, Integrity, and Availability (CIA). CSoC analysts rely on these systems to make decisions about the detected threats. However, IDSs designed using Deep Learning (DL) techniques are often treated as black box models and do not provide a justification for their predictions. This creates a barrier for CSoC analysts, as they are unable to improve their decisions based on the model’s predictions. One solution to this problem is to design explainable IDS (X-IDS). This survey reviews the state-of-the-art in explainable AI (XAI) for IDS, its current challenges, and discusses how these challenges span to the design of an X-IDS. In particular, we discuss black box and white box approaches comprehensively. We also present the tradeoff between these approaches in terms of their performance and ability to produce explanations. Furthermore, we propose a generic architecture that considers human-in-the-loop which can be used as a guideline when designing an X-IDS. Research recommendations are given from three critical viewpoints: the need to define explainability for IDS, the need to create explanations tailored to various stakeholders, and the need to design metrics to evaluate explanations.https://ieeexplore.ieee.org/document/9927396/Explainable intrusion detection systemsexplainable artificial intelligencemachine learningdeep learningwhite boxblack box
spellingShingle Subash Neupane
Jesse Ables
William Anderson
Sudip Mittal
Shahram Rahimi
Ioana Banicescu
Maria Seale
Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities
IEEE Access
Explainable intrusion detection systems
explainable artificial intelligence
machine learning
deep learning
white box
black box
title Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities
title_full Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities
title_fullStr Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities
title_full_unstemmed Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities
title_short Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunities
title_sort explainable intrusion detection systems x ids a survey of current methods challenges and opportunities
topic Explainable intrusion detection systems
explainable artificial intelligence
machine learning
deep learning
white box
black box
url https://ieeexplore.ieee.org/document/9927396/
work_keys_str_mv AT subashneupane explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities
AT jesseables explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities
AT williamanderson explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities
AT sudipmittal explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities
AT shahramrahimi explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities
AT ioanabanicescu explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities
AT mariaseale explainableintrusiondetectionsystemsxidsasurveyofcurrentmethodschallengesandopportunities