A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection
In this study, a new approach for novelty and anomaly detection, called HPFuzzNDA, is introduced. It is similar to the Possibilistic Fuzzy multi-class Novelty Detector (PFuzzND), which was originally developed for data streams. Both algorithms initially use a portion of labelled data from known clas...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-09-01
|
| Series: | Algorithms |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1999-4893/15/10/342 |
| _version_ | 1797476070890405888 |
|---|---|
| author | Shakhnaz Akhmedova Vladimir Stanovov Yukihiro Kamiya |
| author_facet | Shakhnaz Akhmedova Vladimir Stanovov Yukihiro Kamiya |
| author_sort | Shakhnaz Akhmedova |
| collection | DOAJ |
| description | In this study, a new approach for novelty and anomaly detection, called HPFuzzNDA, is introduced. It is similar to the Possibilistic Fuzzy multi-class Novelty Detector (PFuzzND), which was originally developed for data streams. Both algorithms initially use a portion of labelled data from known classes to divide them into a given number of clusters, and then attempt to determine if the new instances, which may be unlabelled, belong to the known or novel classes or if they are anomalies, namely if they are extreme values that deviate from other observations, indicating noise or errors in measurement. However, for each class in HPFuzzNDA clusters are designed by using the new evolutionary algorithm NL-SHADE-RSP, the latter is a modification of the well-known L-SHADE approach. Additionally, the number of clusters for all classes is automatically adjusted in each step of HPFuzzNDA to improve its efficiency. The performance of the HPFuzzNDA approach was evaluated on a set of benchmark problems, specifically generated for novelty and anomaly detection. Experimental results demonstrated the workability and usefulness of the proposed approach as it was able to detect extensions of the known classes and to find new classes in addition to the anomalies. Moreover, numerical results showed that it outperformed PFuzzND. This was exhibited by the new mechanism proposed for cluster adjustments allowing HPFuzzNDA to achieve better classification accuracy in addition to better results in terms of macro <i>F</i>-score metric. |
| first_indexed | 2024-03-09T20:52:46Z |
| format | Article |
| id | doaj.art-9e4cfc73785e46ed9f5245406086592b |
| institution | Directory Open Access Journal |
| issn | 1999-4893 |
| language | English |
| last_indexed | 2024-03-09T20:52:46Z |
| publishDate | 2022-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Algorithms |
| spelling | doaj.art-9e4cfc73785e46ed9f5245406086592b2023-11-23T22:29:58ZengMDPI AGAlgorithms1999-48932022-09-01151034210.3390/a15100342A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly DetectionShakhnaz Akhmedova0Vladimir Stanovov1Yukihiro Kamiya2Independent Researcher, 13353 Berlin, GermanyIndependent Researcher, 660037 Krasnoyarsk, RussiaDepartment of Information Science and Technology, Aichi Prefectural University, Nakagute 480-1198, JapanIn this study, a new approach for novelty and anomaly detection, called HPFuzzNDA, is introduced. It is similar to the Possibilistic Fuzzy multi-class Novelty Detector (PFuzzND), which was originally developed for data streams. Both algorithms initially use a portion of labelled data from known classes to divide them into a given number of clusters, and then attempt to determine if the new instances, which may be unlabelled, belong to the known or novel classes or if they are anomalies, namely if they are extreme values that deviate from other observations, indicating noise or errors in measurement. However, for each class in HPFuzzNDA clusters are designed by using the new evolutionary algorithm NL-SHADE-RSP, the latter is a modification of the well-known L-SHADE approach. Additionally, the number of clusters for all classes is automatically adjusted in each step of HPFuzzNDA to improve its efficiency. The performance of the HPFuzzNDA approach was evaluated on a set of benchmark problems, specifically generated for novelty and anomaly detection. Experimental results demonstrated the workability and usefulness of the proposed approach as it was able to detect extensions of the known classes and to find new classes in addition to the anomalies. Moreover, numerical results showed that it outperformed PFuzzND. This was exhibited by the new mechanism proposed for cluster adjustments allowing HPFuzzNDA to achieve better classification accuracy in addition to better results in terms of macro <i>F</i>-score metric.https://www.mdpi.com/1999-4893/15/10/342anomaly detectionnovelty detectionfuzzy clusteringevolutionary computationclassification |
| spellingShingle | Shakhnaz Akhmedova Vladimir Stanovov Yukihiro Kamiya A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection Algorithms anomaly detection novelty detection fuzzy clustering evolutionary computation classification |
| title | A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection |
| title_full | A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection |
| title_fullStr | A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection |
| title_full_unstemmed | A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection |
| title_short | A Hybrid Clustering Approach Based on Fuzzy Logic and Evolutionary Computation for Anomaly Detection |
| title_sort | hybrid clustering approach based on fuzzy logic and evolutionary computation for anomaly detection |
| topic | anomaly detection novelty detection fuzzy clustering evolutionary computation classification |
| url | https://www.mdpi.com/1999-4893/15/10/342 |
| work_keys_str_mv | AT shakhnazakhmedova ahybridclusteringapproachbasedonfuzzylogicandevolutionarycomputationforanomalydetection AT vladimirstanovov ahybridclusteringapproachbasedonfuzzylogicandevolutionarycomputationforanomalydetection AT yukihirokamiya ahybridclusteringapproachbasedonfuzzylogicandevolutionarycomputationforanomalydetection AT shakhnazakhmedova hybridclusteringapproachbasedonfuzzylogicandevolutionarycomputationforanomalydetection AT vladimirstanovov hybridclusteringapproachbasedonfuzzylogicandevolutionarycomputationforanomalydetection AT yukihirokamiya hybridclusteringapproachbasedonfuzzylogicandevolutionarycomputationforanomalydetection |