Identifying Heterogeneity in Decision-Making

Individuals often make different decisions when faced with the same problem. This variation arises naturally in decision-making processes due to differences in agent-specific factors, such as training, personal preference, and opinion. In many real-world scenarios, understanding where this variation...

Full description

Bibliographic Details
Main Author: Lim, Justin
Other Authors: Sontag, David
Format: Thesis
Published: Massachusetts Institute of Technology 2022
Online Access:https://hdl.handle.net/1721.1/139263
_version_ 1826214324706738176
author Lim, Justin
author2 Sontag, David
author_facet Sontag, David
Lim, Justin
author_sort Lim, Justin
collection MIT
description Individuals often make different decisions when faced with the same problem. This variation arises naturally in decision-making processes due to differences in agent-specific factors, such as training, personal preference, and opinion. In many real-world scenarios, understanding where this variation occurs is critical to inform research and policy-making. For instance, in a clinical context, it is important to identify the types of patients on which the treatment they receive depends greatly on which doctor they visit. Identifying such regions of disagreement can reveal gaps in knowledge or opportunities where best practices can be clarified. In the medical context, it can directly assist the development of more comprehensive treatment guidelines, or suggest hypotheses to be tested in medical trials. In this thesis, we present algorithmic methods to identify heterogeneity in decision-making, by characterizing the regions of disagreement where variation can be attributed largely to the decision-maker. These methods range from approximate methods to exact solutions. We provide generalization bounds where possible and test each method’s performance and computational efficiency using a comprehensive set of synthetic experiments. To demonstrate how these algorithms can be used to obtain insights in clinical decision-making, we present an extensive case study on decision-making for first-line diabetes patients, using an observational dataset from a large insurance provider. We identify subpopulations of patients where this first-line decision varies by provider, and evaluate the effect of this variation on downstream outcomes. Our algorithms are implemented in an easily-usable way and are available to the public.
first_indexed 2024-09-23T16:03:34Z
format Thesis
id mit-1721.1/139263
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T16:03:34Z
publishDate 2022
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1392632022-01-15T03:05:41Z Identifying Heterogeneity in Decision-Making Lim, Justin Sontag, David Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Individuals often make different decisions when faced with the same problem. This variation arises naturally in decision-making processes due to differences in agent-specific factors, such as training, personal preference, and opinion. In many real-world scenarios, understanding where this variation occurs is critical to inform research and policy-making. For instance, in a clinical context, it is important to identify the types of patients on which the treatment they receive depends greatly on which doctor they visit. Identifying such regions of disagreement can reveal gaps in knowledge or opportunities where best practices can be clarified. In the medical context, it can directly assist the development of more comprehensive treatment guidelines, or suggest hypotheses to be tested in medical trials. In this thesis, we present algorithmic methods to identify heterogeneity in decision-making, by characterizing the regions of disagreement where variation can be attributed largely to the decision-maker. These methods range from approximate methods to exact solutions. We provide generalization bounds where possible and test each method’s performance and computational efficiency using a comprehensive set of synthetic experiments. To demonstrate how these algorithms can be used to obtain insights in clinical decision-making, we present an extensive case study on decision-making for first-line diabetes patients, using an observational dataset from a large insurance provider. We identify subpopulations of patients where this first-line decision varies by provider, and evaluate the effect of this variation on downstream outcomes. Our algorithms are implemented in an easily-usable way and are available to the public. M.Eng. 2022-01-14T15:00:11Z 2022-01-14T15:00:11Z 2021-06 2021-06-17T20:13:35.601Z Thesis https://hdl.handle.net/1721.1/139263 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Lim, Justin
Identifying Heterogeneity in Decision-Making
title Identifying Heterogeneity in Decision-Making
title_full Identifying Heterogeneity in Decision-Making
title_fullStr Identifying Heterogeneity in Decision-Making
title_full_unstemmed Identifying Heterogeneity in Decision-Making
title_short Identifying Heterogeneity in Decision-Making
title_sort identifying heterogeneity in decision making
url https://hdl.handle.net/1721.1/139263
work_keys_str_mv AT limjustin identifyingheterogeneityindecisionmaking