From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making

Prediction algorithms are regularly used to support and automate high-stakes policy decisions about the allocation of scarce public resources. However, data-driven decision-making raises problems of algorithmic fairness and justice. So far, fairness and justice are frequently conflated, with the con...

Full description

Bibliographic Details
Main Authors: Matthias Kuppler, Christoph Kern, Ruben L. Bach, Frauke Kreuter
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-10-01
Series:Frontiers in Sociology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fsoc.2022.883999/full
_version_ 1811194683968192512
author Matthias Kuppler
Christoph Kern
Christoph Kern
Ruben L. Bach
Frauke Kreuter
Frauke Kreuter
author_facet Matthias Kuppler
Christoph Kern
Christoph Kern
Ruben L. Bach
Frauke Kreuter
Frauke Kreuter
author_sort Matthias Kuppler
collection DOAJ
description Prediction algorithms are regularly used to support and automate high-stakes policy decisions about the allocation of scarce public resources. However, data-driven decision-making raises problems of algorithmic fairness and justice. So far, fairness and justice are frequently conflated, with the consequence that distributive justice concerns are not addressed explicitly. In this paper, we approach this issue by distinguishing (a) fairness as a property of the algorithm used for the prediction task from (b) justice as a property of the allocation principle used for the decision task in data-driven decision-making. The distinction highlights the different logic underlying concerns about fairness and justice and permits a more systematic investigation of the interrelations between the two concepts. We propose a new notion of algorithmic fairness called error fairness which requires prediction errors to not differ systematically across individuals. Drawing on sociological and philosophical discourse on local justice, we present a principled way to include distributive justice concerns into data-driven decision-making. We propose that allocation principles are just if they adhere to well-justified distributive justice principles. Moving beyond the one-sided focus on algorithmic fairness, we thereby make a first step toward the explicit implementation of distributive justice into data-driven decision-making.
first_indexed 2024-04-12T00:30:48Z
format Article
id doaj.art-53530bf0c49543a2903e936506017dbb
institution Directory Open Access Journal
issn 2297-7775
language English
last_indexed 2024-04-12T00:30:48Z
publishDate 2022-10-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Sociology
spelling doaj.art-53530bf0c49543a2903e936506017dbb2022-12-22T03:55:20ZengFrontiers Media S.A.Frontiers in Sociology2297-77752022-10-01710.3389/fsoc.2022.883999883999From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-makingMatthias Kuppler0Christoph Kern1Christoph Kern2Ruben L. Bach3Frauke Kreuter4Frauke Kreuter5Department of Social Sciences, University of Siegen, Siegen, GermanySchool of Social Sciences, University of Mannheim, Mannheim, GermanyJoint Program in Survey Methodology, University of Maryland, College Park, MD, United StatesSchool of Social Sciences, University of Mannheim, Mannheim, GermanyJoint Program in Survey Methodology, University of Maryland, College Park, MD, United StatesDepartment of Statistics, LMU Munich, Munich, GermanyPrediction algorithms are regularly used to support and automate high-stakes policy decisions about the allocation of scarce public resources. However, data-driven decision-making raises problems of algorithmic fairness and justice. So far, fairness and justice are frequently conflated, with the consequence that distributive justice concerns are not addressed explicitly. In this paper, we approach this issue by distinguishing (a) fairness as a property of the algorithm used for the prediction task from (b) justice as a property of the allocation principle used for the decision task in data-driven decision-making. The distinction highlights the different logic underlying concerns about fairness and justice and permits a more systematic investigation of the interrelations between the two concepts. We propose a new notion of algorithmic fairness called error fairness which requires prediction errors to not differ systematically across individuals. Drawing on sociological and philosophical discourse on local justice, we present a principled way to include distributive justice concerns into data-driven decision-making. We propose that allocation principles are just if they adhere to well-justified distributive justice principles. Moving beyond the one-sided focus on algorithmic fairness, we thereby make a first step toward the explicit implementation of distributive justice into data-driven decision-making.https://www.frontiersin.org/articles/10.3389/fsoc.2022.883999/fullautomationpredictionalgorithmfairnessdistributive justice
spellingShingle Matthias Kuppler
Christoph Kern
Christoph Kern
Ruben L. Bach
Frauke Kreuter
Frauke Kreuter
From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making
Frontiers in Sociology
automation
prediction
algorithm
fairness
distributive justice
title From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making
title_full From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making
title_fullStr From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making
title_full_unstemmed From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making
title_short From fair predictions to just decisions? Conceptualizing algorithmic fairness and distributive justice in the context of data-driven decision-making
title_sort from fair predictions to just decisions conceptualizing algorithmic fairness and distributive justice in the context of data driven decision making
topic automation
prediction
algorithm
fairness
distributive justice
url https://www.frontiersin.org/articles/10.3389/fsoc.2022.883999/full
work_keys_str_mv AT matthiaskuppler fromfairpredictionstojustdecisionsconceptualizingalgorithmicfairnessanddistributivejusticeinthecontextofdatadrivendecisionmaking
AT christophkern fromfairpredictionstojustdecisionsconceptualizingalgorithmicfairnessanddistributivejusticeinthecontextofdatadrivendecisionmaking
AT christophkern fromfairpredictionstojustdecisionsconceptualizingalgorithmicfairnessanddistributivejusticeinthecontextofdatadrivendecisionmaking
AT rubenlbach fromfairpredictionstojustdecisionsconceptualizingalgorithmicfairnessanddistributivejusticeinthecontextofdatadrivendecisionmaking
AT fraukekreuter fromfairpredictionstojustdecisionsconceptualizingalgorithmicfairnessanddistributivejusticeinthecontextofdatadrivendecisionmaking
AT fraukekreuter fromfairpredictionstojustdecisionsconceptualizingalgorithmicfairnessanddistributivejusticeinthecontextofdatadrivendecisionmaking