Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds
© 2020 for this paper by its authors. Increasing concern about discrimination and bias in datadriven decision making systems has led to a growth in academic and popular interest in algorithmic fairness. Prior work on fairness in machine learning has focused primarily on the setting in which all the...
| Main Authors: | , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
2021
|
| Online Access: | https://hdl.handle.net/1721.1/137071 |
| _version_ | 1811093655462608896 |
|---|---|
| author | Bakker, M Valdés, HR Patrick Tu, D Gummadi, KP Varshney, KR Weller, A Pentland, AS |
| author2 | MIT-IBM Watson AI Lab |
| author_facet | MIT-IBM Watson AI Lab Bakker, M Valdés, HR Patrick Tu, D Gummadi, KP Varshney, KR Weller, A Pentland, AS |
| author_sort | Bakker, M |
| collection | MIT |
| description | © 2020 for this paper by its authors. Increasing concern about discrimination and bias in datadriven decision making systems has led to a growth in academic and popular interest in algorithmic fairness. Prior work on fairness in machine learning has focused primarily on the setting in which all the information (features) needed to make a confident decision about an individual is readily available. In practice, however, many applications allow further information to be acquired at a feature-specific cost. For example, when diagnosing a patient, the doctor starts with only a handful of symptoms but progressively improves the diagnosis by acquiring additional information before making a final decision. We show that we can achieve fairness by leveraging a natural affordance of this setting: The decision on when to stop acquiring more features and proceeding to predict. First, we show that by setting a single set of confidence thresholds for stopping, we can attain equal error rates across arbitrary groups. Second, we extend the framework to a set of group-specific confidence thresholds which ensure that a classifier achieves equal opportunity (equal falsepositive or false-negative rates). The confidence thresholds naturally achieve fairness by redistributing the budget across individuals. This leads to statistical fairness across groups but also addresses the limitation that current statistical fairness methods fail to provide any guarantees to individuals. Finally, using two public datasets, we confirm the effectiveness of our methods empirically and investigate the limitations. |
| first_indexed | 2024-09-23T15:48:17Z |
| format | Article |
| id | mit-1721.1/137071 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T15:48:17Z |
| publishDate | 2021 |
| record_format | dspace |
| spelling | mit-1721.1/1370712023-01-11T20:32:47Z Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds Bakker, M Valdés, HR Patrick Tu, D Gummadi, KP Varshney, KR Weller, A Pentland, AS MIT-IBM Watson AI Lab Massachusetts Institute of Technology. Media Laboratory © 2020 for this paper by its authors. Increasing concern about discrimination and bias in datadriven decision making systems has led to a growth in academic and popular interest in algorithmic fairness. Prior work on fairness in machine learning has focused primarily on the setting in which all the information (features) needed to make a confident decision about an individual is readily available. In practice, however, many applications allow further information to be acquired at a feature-specific cost. For example, when diagnosing a patient, the doctor starts with only a handful of symptoms but progressively improves the diagnosis by acquiring additional information before making a final decision. We show that we can achieve fairness by leveraging a natural affordance of this setting: The decision on when to stop acquiring more features and proceeding to predict. First, we show that by setting a single set of confidence thresholds for stopping, we can attain equal error rates across arbitrary groups. Second, we extend the framework to a set of group-specific confidence thresholds which ensure that a classifier achieves equal opportunity (equal falsepositive or false-negative rates). The confidence thresholds naturally achieve fairness by redistributing the budget across individuals. This leads to statistical fairness across groups but also addresses the limitation that current statistical fairness methods fail to provide any guarantees to individuals. Finally, using two public datasets, we confirm the effectiveness of our methods empirically and investigate the limitations. 2021-11-02T13:07:41Z 2021-11-02T13:07:41Z 2020 2021-07-01T15:27:17Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/137071 Bakker, M, Valdés, HR, Patrick Tu, D, Gummadi, KP, Varshney, KR et al. 2020. "Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds." CEUR Workshop Proceedings, 2560. en http://ceur-ws.org/Vol-2560/paper24.pdf CEUR Workshop Proceedings Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf CEUR Workshop Proceedings |
| spellingShingle | Bakker, M Valdés, HR Patrick Tu, D Gummadi, KP Varshney, KR Weller, A Pentland, AS Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds |
| title | Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds |
| title_full | Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds |
| title_fullStr | Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds |
| title_full_unstemmed | Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds |
| title_short | Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds |
| title_sort | fair enough improving fairness in budget constrained decision making using confidence thresholds |
| url | https://hdl.handle.net/1721.1/137071 |
| work_keys_str_mv | AT bakkerm fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds AT valdeshr fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds AT patricktud fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds AT gummadikp fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds AT varshneykr fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds AT wellera fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds AT pentlandas fairenoughimprovingfairnessinbudgetconstraineddecisionmakingusingconfidencethresholds |