A Theory of Uncertainty Variables for State Estimation and Inference

© 2019 IEEE. Probability theory forms an overarching framework for modeling uncertainty, and by extension, also in designing state estimation and inference algorithms. While it provides a good foundation to system modeling, analysis, and an understanding of the real world, its application to algorit...

Full description

Bibliographic Details
Main Authors: Talak, Rajat, Karaman, Sertac, Modiano, Eytan
Other Authors: Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Format: Article
Language:English
Published: IEEE 2021
Online Access:https://hdl.handle.net/1721.1/136725
_version_ 1826215245478100992
author Talak, Rajat
Karaman, Sertac
Modiano, Eytan
author2 Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
author_facet Massachusetts Institute of Technology. Laboratory for Information and Decision Systems
Talak, Rajat
Karaman, Sertac
Modiano, Eytan
author_sort Talak, Rajat
collection MIT
description © 2019 IEEE. Probability theory forms an overarching framework for modeling uncertainty, and by extension, also in designing state estimation and inference algorithms. While it provides a good foundation to system modeling, analysis, and an understanding of the real world, its application to algorithm design suffers from computational intractability. In this work, we develop a new framework of uncertainty variables to model uncertainty. A simple uncertainty variable is characterized by an uncertainty set, in which its realization is bound to lie, while the conditional uncertainty is characterized by a set map, from a given realization of a variable to a set of possible realizations of another variable. We prove Bayes' law and the law of total probability equivalents for uncertainty variables. We define a notion of independence, conditional independence, and pairwise independence for a collection of uncertainty variables, and show that this new notion of independence preserves the properties of independence defined over random variables. We then develop a graphical model, namely Bayesian uncertainty network, a Bayesian network equivalent defined over a collection of uncertainty variables, and show that all the natural conditional independence properties, expected out of a Bayesian network, hold for the Bayesian uncertainty network. We also define the notion of point estimate, and show its relation with the maximum a posteriori estimate.
first_indexed 2024-09-23T16:20:04Z
format Article
id mit-1721.1/136725
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T16:20:04Z
publishDate 2021
publisher IEEE
record_format dspace
spelling mit-1721.1/1367252023-06-28T18:25:08Z A Theory of Uncertainty Variables for State Estimation and Inference Talak, Rajat Karaman, Sertac Modiano, Eytan Massachusetts Institute of Technology. Laboratory for Information and Decision Systems © 2019 IEEE. Probability theory forms an overarching framework for modeling uncertainty, and by extension, also in designing state estimation and inference algorithms. While it provides a good foundation to system modeling, analysis, and an understanding of the real world, its application to algorithm design suffers from computational intractability. In this work, we develop a new framework of uncertainty variables to model uncertainty. A simple uncertainty variable is characterized by an uncertainty set, in which its realization is bound to lie, while the conditional uncertainty is characterized by a set map, from a given realization of a variable to a set of possible realizations of another variable. We prove Bayes' law and the law of total probability equivalents for uncertainty variables. We define a notion of independence, conditional independence, and pairwise independence for a collection of uncertainty variables, and show that this new notion of independence preserves the properties of independence defined over random variables. We then develop a graphical model, namely Bayesian uncertainty network, a Bayesian network equivalent defined over a collection of uncertainty variables, and show that all the natural conditional independence properties, expected out of a Bayesian network, hold for the Bayesian uncertainty network. We also define the notion of point estimate, and show its relation with the maximum a posteriori estimate. 2021-10-28T18:07:51Z 2021-10-28T18:07:51Z 2019-09 2021-04-30T17:20:47Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/136725 Talak, Rajat, Karaman, Sertac and Modiano, Eytan. 2019. "A Theory of Uncertainty Variables for State Estimation and Inference." 2019 57th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2019. en 10.1109/allerton.2019.8919919 2019 57th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2019 Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf IEEE arXiv
spellingShingle Talak, Rajat
Karaman, Sertac
Modiano, Eytan
A Theory of Uncertainty Variables for State Estimation and Inference
title A Theory of Uncertainty Variables for State Estimation and Inference
title_full A Theory of Uncertainty Variables for State Estimation and Inference
title_fullStr A Theory of Uncertainty Variables for State Estimation and Inference
title_full_unstemmed A Theory of Uncertainty Variables for State Estimation and Inference
title_short A Theory of Uncertainty Variables for State Estimation and Inference
title_sort theory of uncertainty variables for state estimation and inference
url https://hdl.handle.net/1721.1/136725
work_keys_str_mv AT talakrajat atheoryofuncertaintyvariablesforstateestimationandinference
AT karamansertac atheoryofuncertaintyvariablesforstateestimationandinference
AT modianoeytan atheoryofuncertaintyvariablesforstateestimationandinference
AT talakrajat theoryofuncertaintyvariablesforstateestimationandinference
AT karamansertac theoryofuncertaintyvariablesforstateestimationandinference
AT modianoeytan theoryofuncertaintyvariablesforstateestimationandinference