Individual fairness guarantees for neural networks

We consider the problem of certifying the individual fairness (IF) of feed-forward neural networks (NNs). In particular, we work with the epsilon-delta-IF formulation, which, given a NN and a similarity metric learnt from data, requires that the output difference between any pair of epsilon-similar...

Full description

Bibliographic Details
Main Authors: Benussi, E, Patane, A, Wicker, M, Laurenti, L, Kwiatkowska, M
Format: Conference item
Language:English
Published: International Joint Conferences on Artificial Intelligence 2022
_version_ 1797107438114045952
author Benussi, E
Patane, A
Wicker, M
Laurenti, L
Kwiatkowska, M
author_facet Benussi, E
Patane, A
Wicker, M
Laurenti, L
Kwiatkowska, M
author_sort Benussi, E
collection OXFORD
description We consider the problem of certifying the individual fairness (IF) of feed-forward neural networks (NNs). In particular, we work with the epsilon-delta-IF formulation, which, given a NN and a similarity metric learnt from data, requires that the output difference between any pair of epsilon-similar individuals is bounded by a maximum decision tolerance delta >= 0. Working with a range of metrics, including the Mahalanobis distance, we propose a method to overapproximate the resulting optimisation problem using piecewise-linear functions to lower and upper bound the NN's non-linearities globally over the input space. We encode this computation as the solution of a Mixed-Integer Linear Programming problem and demonstrate that it can be used to compute IF guarantees on four datasets widely used for fairness benchmarking. We show how this formulation can be used to encourage models' fairness at training time by modifying the NN loss, and empirically confirm our approach yields NNs that are orders of magnitude fairer than state-of-the-art methods.
first_indexed 2024-03-07T07:16:05Z
format Conference item
id oxford-uuid:f1ceaf52-9ccd-436f-8816-37cf325f2025
institution University of Oxford
language English
last_indexed 2024-03-07T07:16:05Z
publishDate 2022
publisher International Joint Conferences on Artificial Intelligence
record_format dspace
spelling oxford-uuid:f1ceaf52-9ccd-436f-8816-37cf325f20252022-07-28T16:58:16ZIndividual fairness guarantees for neural networksConference itemhttp://purl.org/coar/resource_type/c_5794uuid:f1ceaf52-9ccd-436f-8816-37cf325f2025EnglishSymplectic ElementsInternational Joint Conferences on Artificial Intelligence2022Benussi, EPatane, AWicker, MLaurenti, LKwiatkowska, MWe consider the problem of certifying the individual fairness (IF) of feed-forward neural networks (NNs). In particular, we work with the epsilon-delta-IF formulation, which, given a NN and a similarity metric learnt from data, requires that the output difference between any pair of epsilon-similar individuals is bounded by a maximum decision tolerance delta >= 0. Working with a range of metrics, including the Mahalanobis distance, we propose a method to overapproximate the resulting optimisation problem using piecewise-linear functions to lower and upper bound the NN's non-linearities globally over the input space. We encode this computation as the solution of a Mixed-Integer Linear Programming problem and demonstrate that it can be used to compute IF guarantees on four datasets widely used for fairness benchmarking. We show how this formulation can be used to encourage models' fairness at training time by modifying the NN loss, and empirically confirm our approach yields NNs that are orders of magnitude fairer than state-of-the-art methods.
spellingShingle Benussi, E
Patane, A
Wicker, M
Laurenti, L
Kwiatkowska, M
Individual fairness guarantees for neural networks
title Individual fairness guarantees for neural networks
title_full Individual fairness guarantees for neural networks
title_fullStr Individual fairness guarantees for neural networks
title_full_unstemmed Individual fairness guarantees for neural networks
title_short Individual fairness guarantees for neural networks
title_sort individual fairness guarantees for neural networks
work_keys_str_mv AT benussie individualfairnessguaranteesforneuralnetworks
AT patanea individualfairnessguaranteesforneuralnetworks
AT wickerm individualfairnessguaranteesforneuralnetworks
AT laurentil individualfairnessguaranteesforneuralnetworks
AT kwiatkowskam individualfairnessguaranteesforneuralnetworks