Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers

Deployments of algorithmic decision-making systems (ADMs) by the public sector have been plagued with opacity. There is a baseline lack of visibility of the context and purpose of the ADM system as well as its potential risks to individuals and collective goods. In many cases, citizens are unaware o...

Full description

Bibliographic Details
Main Author: Murad, Maya
Other Authors: Hafrey, Leigh
Format: Thesis
Published: Massachusetts Institute of Technology 2022
Online Access:https://hdl.handle.net/1721.1/139092
_version_ 1811096498197233664
author Murad, Maya
author2 Hafrey, Leigh
author_facet Hafrey, Leigh
Murad, Maya
author_sort Murad, Maya
collection MIT
description Deployments of algorithmic decision-making systems (ADMs) by the public sector have been plagued with opacity. There is a baseline lack of visibility of the context and purpose of the ADM system as well as its potential risks to individuals and collective goods. In many cases, citizens are unaware of the very existence of algorithmic systems that they interact with or that help decide their access to benefits or influence policing. Moreover, disclosures concerning algorithmic systems often take place when their shortcomings (potential harms) are inadvertently exposed, often through the work of public interest groups. Given the increasing adoption of algorithmic systems to automate decisions and services in the public sector, there is a need to operationalize transparency requirements to enable better accountability. While algorithmic transparency can take on many forms, this thesis mainly focuses on the role of public ADM registers in enabling meaningful transparency to the public. In the past year, at least five local governments have launched their very first ADM registers. Drawing upon these early experiences, relevant stakeholder interviews and specifically considering Amsterdam as a case study, we attempt to formalize the concept of a register as both a standardized and interpretable ADM disclosure mechanism, as well as a governance framework that enables coordination between a number of stakeholders to provide of transparency to the public. We also propose models through which public interest groups and civilians can be engaged in the creation, development and launch of public ADM systems through the governance of a register, and outline key benefits and limitations of such models.
first_indexed 2024-09-23T16:44:37Z
format Thesis
id mit-1721.1/139092
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T16:44:37Z
publishDate 2022
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1390922022-01-15T03:03:11Z Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers Murad, Maya Hafrey, Leigh System Design and Management Program. Deployments of algorithmic decision-making systems (ADMs) by the public sector have been plagued with opacity. There is a baseline lack of visibility of the context and purpose of the ADM system as well as its potential risks to individuals and collective goods. In many cases, citizens are unaware of the very existence of algorithmic systems that they interact with or that help decide their access to benefits or influence policing. Moreover, disclosures concerning algorithmic systems often take place when their shortcomings (potential harms) are inadvertently exposed, often through the work of public interest groups. Given the increasing adoption of algorithmic systems to automate decisions and services in the public sector, there is a need to operationalize transparency requirements to enable better accountability. While algorithmic transparency can take on many forms, this thesis mainly focuses on the role of public ADM registers in enabling meaningful transparency to the public. In the past year, at least five local governments have launched their very first ADM registers. Drawing upon these early experiences, relevant stakeholder interviews and specifically considering Amsterdam as a case study, we attempt to formalize the concept of a register as both a standardized and interpretable ADM disclosure mechanism, as well as a governance framework that enables coordination between a number of stakeholders to provide of transparency to the public. We also propose models through which public interest groups and civilians can be engaged in the creation, development and launch of public ADM systems through the governance of a register, and outline key benefits and limitations of such models. S.M. 2022-01-14T14:49:25Z 2022-01-14T14:49:25Z 2021-06 2021-06-25T20:20:45.205Z Thesis https://hdl.handle.net/1721.1/139092 0000-0003-2672-937X In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Murad, Maya
Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers
title Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers
title_full Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers
title_fullStr Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers
title_full_unstemmed Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers
title_short Beyond the "Black Box": Enabling Meaningful Transparency of Algorithmic Decision-Making Systems through Public Registers
title_sort beyond the black box enabling meaningful transparency of algorithmic decision making systems through public registers
url https://hdl.handle.net/1721.1/139092
work_keys_str_mv AT muradmaya beyondtheblackboxenablingmeaningfultransparencyofalgorithmicdecisionmakingsystemsthroughpublicregisters