How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness
Fair machine learning has been focusing on the development of equitable algorithms that address discrimination. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which leads to a poor understanding of the statistical limits of bias mitigation interventions....
| Main Authors: | , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Wiley
2021
|
| _version_ | 1797108531206291456 |
|---|---|
| author | Valdivia, A Sanchez-Monedero, J Casillas, J |
| author_facet | Valdivia, A Sanchez-Monedero, J Casillas, J |
| author_sort | Valdivia, A |
| collection | OXFORD |
| description | Fair machine learning has been focusing on the development of equitable algorithms that address discrimination. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which leads to a poor understanding of the statistical limits of bias mitigation interventions. In this study, a novel methodology is presented to explore the tradeoff in terms of a Pareto front between accuracy and fairness. To this end, we propose a multiobjective framework that seeks to optimize both measures. The experimental framework is focused on logistiregression and decision tree classifiers since they are well-known by the machine learning community. We conclude experimentally that our method can optimize classifiers by being fairer with a small cost on the classification accuracy. We believe that our contribution will help stakeholders of sociotechnical systems to assess how far they can go being fair and accurate, thus serving in the support of enhanced decision making where machine learning is used. |
| first_indexed | 2024-03-07T07:28:59Z |
| format | Journal article |
| id | oxford-uuid:80a3d32a-8b15-4f26-9261-a08b2619c842 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T07:28:59Z |
| publishDate | 2021 |
| publisher | Wiley |
| record_format | dspace |
| spelling | oxford-uuid:80a3d32a-8b15-4f26-9261-a08b2619c8422023-01-04T14:43:13ZHow fair can we go in machine learning? Assessing the boundaries of accuracy and fairnessJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:80a3d32a-8b15-4f26-9261-a08b2619c842EnglishSymplectic ElementsWiley2021Valdivia, ASanchez-Monedero, JCasillas, JFair machine learning has been focusing on the development of equitable algorithms that address discrimination. Yet, many of these fairness-aware approaches aim to obtain a unique solution to the problem, which leads to a poor understanding of the statistical limits of bias mitigation interventions. In this study, a novel methodology is presented to explore the tradeoff in terms of a Pareto front between accuracy and fairness. To this end, we propose a multiobjective framework that seeks to optimize both measures. The experimental framework is focused on logistiregression and decision tree classifiers since they are well-known by the machine learning community. We conclude experimentally that our method can optimize classifiers by being fairer with a small cost on the classification accuracy. We believe that our contribution will help stakeholders of sociotechnical systems to assess how far they can go being fair and accurate, thus serving in the support of enhanced decision making where machine learning is used. |
| spellingShingle | Valdivia, A Sanchez-Monedero, J Casillas, J How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness |
| title | How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness |
| title_full | How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness |
| title_fullStr | How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness |
| title_full_unstemmed | How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness |
| title_short | How fair can we go in machine learning? Assessing the boundaries of accuracy and fairness |
| title_sort | how fair can we go in machine learning assessing the boundaries of accuracy and fairness |
| work_keys_str_mv | AT valdiviaa howfaircanwegoinmachinelearningassessingtheboundariesofaccuracyandfairness AT sanchezmonederoj howfaircanwegoinmachinelearningassessingtheboundariesofaccuracyandfairness AT casillasj howfaircanwegoinmachinelearningassessingtheboundariesofaccuracyandfairness |