Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework
The paper introduces a novel framework for detecting adversarial attacks on machine learning models that classify tabular data. Its purpose is to provide a robust method for the monitoring and continuous auditing of machine learning models for the purpose of detecting malicious data alterations. The...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2023-08-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/13/17/9698 |
_version_ | 1797582894392147968 |
---|---|
author | Piotr Biczyk Łukasz Wawrowski |
author_facet | Piotr Biczyk Łukasz Wawrowski |
author_sort | Piotr Biczyk |
collection | DOAJ |
description | The paper introduces a novel framework for detecting adversarial attacks on machine learning models that classify tabular data. Its purpose is to provide a robust method for the monitoring and continuous auditing of machine learning models for the purpose of detecting malicious data alterations. The core of the framework is based on building machine learning classifiers for the detection of attacks and its type that operate on diagnostic attributes. These diagnostic attributes are obtained not from the original model, but from the surrogate model that has been created by observation of the original model inputs and outputs. The paper presents building blocks for the framework and tests its power for the detection and isolation of attacks in selected scenarios utilizing known attacks and public machine learning data sets. The obtained results pave the road for further experiments and the goal of developing classifiers that can be integrated into real-world scenarios, bolstering the robustness of machine learning applications. |
first_indexed | 2024-03-10T23:28:00Z |
format | Article |
id | doaj.art-bca413c6e48540adb5daca1df09c3539 |
institution | Directory Open Access Journal |
issn | 2076-3417 |
language | English |
last_indexed | 2024-03-10T23:28:00Z |
publishDate | 2023-08-01 |
publisher | MDPI AG |
record_format | Article |
series | Applied Sciences |
spelling | doaj.art-bca413c6e48540adb5daca1df09c35392023-11-19T07:50:35ZengMDPI AGApplied Sciences2076-34172023-08-011317969810.3390/app13179698Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model FrameworkPiotr Biczyk0Łukasz Wawrowski1Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Akademicka 16, 44-100 Gliwice, PolandŁukasiewicz Research Network, Institute of Innovative Technologies EMAG, Leopolda 31, 40-189 Katowice, PolandThe paper introduces a novel framework for detecting adversarial attacks on machine learning models that classify tabular data. Its purpose is to provide a robust method for the monitoring and continuous auditing of machine learning models for the purpose of detecting malicious data alterations. The core of the framework is based on building machine learning classifiers for the detection of attacks and its type that operate on diagnostic attributes. These diagnostic attributes are obtained not from the original model, but from the surrogate model that has been created by observation of the original model inputs and outputs. The paper presents building blocks for the framework and tests its power for the detection and isolation of attacks in selected scenarios utilizing known attacks and public machine learning data sets. The obtained results pave the road for further experiments and the goal of developing classifiers that can be integrated into real-world scenarios, bolstering the robustness of machine learning applications.https://www.mdpi.com/2076-3417/13/17/9698adversarial attacksexplainable artificial intelligencesurrogate modelsdiagnostic attributestrustworthy AI |
spellingShingle | Piotr Biczyk Łukasz Wawrowski Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework Applied Sciences adversarial attacks explainable artificial intelligence surrogate models diagnostic attributes trustworthy AI |
title | Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework |
title_full | Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework |
title_fullStr | Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework |
title_full_unstemmed | Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework |
title_short | Detecting and Isolating Adversarial Attacks Using Characteristics of the Surrogate Model Framework |
title_sort | detecting and isolating adversarial attacks using characteristics of the surrogate model framework |
topic | adversarial attacks explainable artificial intelligence surrogate models diagnostic attributes trustworthy AI |
url | https://www.mdpi.com/2076-3417/13/17/9698 |
work_keys_str_mv | AT piotrbiczyk detectingandisolatingadversarialattacksusingcharacteristicsofthesurrogatemodelframework AT łukaszwawrowski detectingandisolatingadversarialattacksusingcharacteristicsofthesurrogatemodelframework |