Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis

Thesis (S.M. in Technology and Policy)--Massachusetts Institute of Technology, Engineering Systems Division, Technology and Policy Program, 2009.

Bibliographic Details
Main Author: Weiss, Rebecca (Rebecca Jennifer)
Other Authors: Drazen Prelec.
Format: Thesis
Language:eng
Published: Massachusetts Institute of Technology 2010
Subjects:
Online Access:http://hdl.handle.net/1721.1/53066
_version_ 1826213174032990208
author Weiss, Rebecca (Rebecca Jennifer)
author2 Drazen Prelec.
author_facet Drazen Prelec.
Weiss, Rebecca (Rebecca Jennifer)
author_sort Weiss, Rebecca (Rebecca Jennifer)
collection MIT
description Thesis (S.M. in Technology and Policy)--Massachusetts Institute of Technology, Engineering Systems Division, Technology and Policy Program, 2009.
first_indexed 2024-09-23T15:44:30Z
format Thesis
id mit-1721.1/53066
institution Massachusetts Institute of Technology
language eng
last_indexed 2024-09-23T15:44:30Z
publishDate 2010
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/530662022-01-31T20:45:25Z Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis Proposed application of the Bayesian Truth Serum for policy analysis Weiss, Rebecca (Rebecca Jennifer) Drazen Prelec. Massachusetts Institute of Technology. Technology and Policy Program. Massachusetts Institute of Technology. Engineering Systems Division Technology and Policy Program Engineering Systems Division. Technology and Policy Program. Thesis (S.M. in Technology and Policy)--Massachusetts Institute of Technology, Engineering Systems Division, Technology and Policy Program, 2009. Includes bibliographical references (p. 59-63). Uncertainty and risk are obstacles that nearly all policy-makers encounter during their careers. However, evaluating uncertainty and risk can be difficult since these concepts may be broadly defined. This may result in inaccurate estimates of risk and uncertainty. Expert elicitation is a formal, structured method of obtaining subjective expert judgment in scenarios where objective data is unobtainable. It is designed to reduce the influence of ambiguity on expert judgment, meaning that analysts may use such subjective data as if it were objectively generated. Expert elicitation methods tend to aggregate expert judgment in order to create a unified response, but determining how to combine expert opinions remains a difficult problem. In this thesis, a review of the literature and background behind defining expertise and expert elicitation will be provided. Additionally, this thesis introduces the Bayesian Truth Serum as a potential weighting algorithm for combining expert judgments. As opposed to other weighting algorithms, the Bayesian Truth Serum uses the metaknowledge of experts to create weights for aggregation. Using such information may prove superior to assuming a normal distribution of expertise or relying upon experts to provide estimates of their own expertise. by Rebecca Weiss. S.M.in Technology and Policy 2010-03-25T14:55:51Z 2010-03-25T14:55:51Z 2009 2009 Thesis http://hdl.handle.net/1721.1/53066 501829428 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 63 p. application/pdf Massachusetts Institute of Technology
spellingShingle Engineering Systems Division.
Technology and Policy Program.
Weiss, Rebecca (Rebecca Jennifer)
Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis
title Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis
title_full Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis
title_fullStr Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis
title_full_unstemmed Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis
title_short Optimally aggregating elicited expertise : a proposed application of the Bayesian Truth Serum for policy analysis
title_sort optimally aggregating elicited expertise a proposed application of the bayesian truth serum for policy analysis
topic Engineering Systems Division.
Technology and Policy Program.
url http://hdl.handle.net/1721.1/53066
work_keys_str_mv AT weissrebeccarebeccajennifer optimallyaggregatingelicitedexpertiseaproposedapplicationofthebayesiantruthserumforpolicyanalysis
AT weissrebeccarebeccajennifer proposedapplicationofthebayesiantruthserumforpolicyanalysis