Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream

Intrusion Detection Systems (IDS) serve as critical components in safeguarding network security by detecting malicious activities. Although IDS has recently been treated primarily through the lens of machine learning, challenges persist, particularly with high-dimensional data and feature drift. Fea...

Full description

Bibliographic Details
Main Authors: Mustafa Sabah Noori, Ratna K. Z. Sahbudin, Aduwati Sali, Fazirulhisyam Hashim
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10318159/
_version_ 1797454727862026240
author Mustafa Sabah Noori
Ratna K. Z. Sahbudin
Aduwati Sali
Fazirulhisyam Hashim
author_facet Mustafa Sabah Noori
Ratna K. Z. Sahbudin
Aduwati Sali
Fazirulhisyam Hashim
author_sort Mustafa Sabah Noori
collection DOAJ
description Intrusion Detection Systems (IDS) serve as critical components in safeguarding network security by detecting malicious activities. Although IDS has recently been treated primarily through the lens of machine learning, challenges persist, particularly with high-dimensional data and feature drift. Feature drift pertains to the dynamic nature of feature significance, which can fluctuate over time, complicating the task of stable and effective intrusion detection. The existing Genetic Programming (GP)-combiner based ensemble classifier framework demonstrates notable efficiency in online intrusion detection, especially in accommodating concept drift. However, it does not adequately address the specific type of concept drift known as feature drift. To rectify this gap, this article proposes a refined version of GP-combiner, named Dynamic Feature Aware GP Ensemble (DFA-GPE). This advanced framework incorporates an improved variant of Variable Length Multi-Objective Particle Swarm Optimization (VLMO-PSO) to dynamically manage feature drift. The proposed VLMO-PSO employs a smart population initialization strategy based on Bernoulli distribution and symmetric uncertainty. It also utilizes a unique set of transfer functions that map the mobility equation outcomes to the decision space. To further optimize the process, the framework introduces a novel exemplar selection method, striking a balance between exploration and exploitation. DFA-GPE’s final feature selection decisions are informed by statistical analyses of feature weights, effectively addressing the challenge of dynamic feature selection as a multi-objective optimization problem that simultaneously enhances accuracy and conserves memory. Comprehensive evaluation of DFA-GPE on two benchmark datasets, namely HIKARI 2021 and TON_IoT 2020, reveals its robust performance across all metrics. From experiment results, our framework attains 99.09% and 92.64% accuracy on both datasets, respectively, while simultaneously reducing memory consumption. Hence, DFA-GPE emerges as a comprehensive framework adept at tackling the most pertinent issues related to stream data classification within IDS, notably outperforming existing methodologies.
first_indexed 2024-03-09T15:42:15Z
format Article
id doaj.art-d060cd77f81146e5afeb71dc2f9c6c37
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-09T15:42:15Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-d060cd77f81146e5afeb71dc2f9c6c372023-11-25T00:01:06ZengIEEEIEEE Access2169-35362023-01-011112859612861710.1109/ACCESS.2023.333300010318159Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data StreamMustafa Sabah Noori0https://orcid.org/0009-0004-1766-5217Ratna K. Z. Sahbudin1Aduwati Sali2https://orcid.org/0000-0002-1692-6516Fazirulhisyam Hashim3https://orcid.org/0000-0003-1880-5643WiPNET Research Centre, Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang, Selangor, MalaysiaDepartment of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia, Serdang, Selangor, MalaysiaWiPNET Research Centre, Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang, Selangor, MalaysiaWiPNET Research Centre, Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia (UPM), Serdang, Selangor, MalaysiaIntrusion Detection Systems (IDS) serve as critical components in safeguarding network security by detecting malicious activities. Although IDS has recently been treated primarily through the lens of machine learning, challenges persist, particularly with high-dimensional data and feature drift. Feature drift pertains to the dynamic nature of feature significance, which can fluctuate over time, complicating the task of stable and effective intrusion detection. The existing Genetic Programming (GP)-combiner based ensemble classifier framework demonstrates notable efficiency in online intrusion detection, especially in accommodating concept drift. However, it does not adequately address the specific type of concept drift known as feature drift. To rectify this gap, this article proposes a refined version of GP-combiner, named Dynamic Feature Aware GP Ensemble (DFA-GPE). This advanced framework incorporates an improved variant of Variable Length Multi-Objective Particle Swarm Optimization (VLMO-PSO) to dynamically manage feature drift. The proposed VLMO-PSO employs a smart population initialization strategy based on Bernoulli distribution and symmetric uncertainty. It also utilizes a unique set of transfer functions that map the mobility equation outcomes to the decision space. To further optimize the process, the framework introduces a novel exemplar selection method, striking a balance between exploration and exploitation. DFA-GPE’s final feature selection decisions are informed by statistical analyses of feature weights, effectively addressing the challenge of dynamic feature selection as a multi-objective optimization problem that simultaneously enhances accuracy and conserves memory. Comprehensive evaluation of DFA-GPE on two benchmark datasets, namely HIKARI 2021 and TON_IoT 2020, reveals its robust performance across all metrics. From experiment results, our framework attains 99.09% and 92.64% accuracy on both datasets, respectively, while simultaneously reducing memory consumption. Hence, DFA-GPE emerges as a comprehensive framework adept at tackling the most pertinent issues related to stream data classification within IDS, notably outperforming existing methodologies.https://ieeexplore.ieee.org/document/10318159/Intrusion detection systemdata stream classificationhigh-dimensionalityconcept driftfeature driftdynamic feature selection
spellingShingle Mustafa Sabah Noori
Ratna K. Z. Sahbudin
Aduwati Sali
Fazirulhisyam Hashim
Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream
IEEE Access
Intrusion detection system
data stream classification
high-dimensionality
concept drift
feature drift
dynamic feature selection
title Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream
title_full Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream
title_fullStr Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream
title_full_unstemmed Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream
title_short Feature Drift Aware for Intrusion Detection System Using Developed Variable Length Particle Swarm Optimization in Data Stream
title_sort feature drift aware for intrusion detection system using developed variable length particle swarm optimization in data stream
topic Intrusion detection system
data stream classification
high-dimensionality
concept drift
feature drift
dynamic feature selection
url https://ieeexplore.ieee.org/document/10318159/
work_keys_str_mv AT mustafasabahnoori featuredriftawareforintrusiondetectionsystemusingdevelopedvariablelengthparticleswarmoptimizationindatastream
AT ratnakzsahbudin featuredriftawareforintrusiondetectionsystemusingdevelopedvariablelengthparticleswarmoptimizationindatastream
AT aduwatisali featuredriftawareforintrusiondetectionsystemusingdevelopedvariablelengthparticleswarmoptimizationindatastream
AT fazirulhisyamhashim featuredriftawareforintrusiondetectionsystemusingdevelopedvariablelengthparticleswarmoptimizationindatastream