Separability as a modeling paradigm in large probabilistic models
Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2011
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/64586 |
| _version_ | 1811070659200024576 |
|---|---|
| author | Richoux, William J., Jr. (William Joseph) |
| author2 | George C. Verghese. |
| author_facet | George C. Verghese. Richoux, William J., Jr. (William Joseph) |
| author_sort | Richoux, William J., Jr. (William Joseph) |
| collection | MIT |
| description | Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011. |
| first_indexed | 2024-09-23T08:39:33Z |
| format | Thesis |
| id | mit-1721.1/64586 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T08:39:33Z |
| publishDate | 2011 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/645862019-04-09T19:01:28Z Separability as a modeling paradigm in large probabilistic models Richoux, William J., Jr. (William Joseph) George C. Verghese. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011. Cataloged from PDF version of thesis. Includes bibliographical references (p. 185-191). Many interesting stochastic models can be formulated as finite-state vector Markov processes, with a state characterized by the values of a collection of random variables. In general, such models suffer from the curse of dimensionality: the size of the state space grows exponentially with the number of underlying random variables, thereby precluding conventional modeling and analysis. A potential cure to this curse is to work with models that allow the propagation of partial information, e.g. marginal distributions, expectations, higher-moments, or cross-correlations, as derived from the joint distribution for the network state. This thesis develops and rigorously investigates the notion of separability, associated with structure in probabilistic models that permits exact propagation of partial information. We show that when partial information can be propagated exactly, it can be done so linearly. The matrices for propagating such partial information share many valuable spectral relationships with the underlying transition matrix of the Markov chain. Separability can be understood from the perspective of subspace invariance in linear systems, though it relates to invariance in a non-standard way. We analyze the asymptotic generality-- as the number of random variables becomes large-of some special cases of separability that permit the propagation of marginal distributions. Within this discussion of separability, we introduce the generalized influence model, which incorporates as special cases two prominent models permitting the propagation of marginal distributions: the influence model and Markov chains on permutations (the symmetric group). The thesis proposes a potentially tractable solution to learning informative model parameters, and illustrates many advantageous properties of the estimator under the assumption of separability. Lastly, we illustrate separability in the general setting without any notion of time-homogeneity, and discuss potential benefits for inference in special cases. by William J. Richoux. Ph.D. 2011-06-20T15:55:54Z 2011-06-20T15:55:54Z 2011 2011 Thesis http://hdl.handle.net/1721.1/64586 727061132 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 191 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Richoux, William J., Jr. (William Joseph) Separability as a modeling paradigm in large probabilistic models |
| title | Separability as a modeling paradigm in large probabilistic models |
| title_full | Separability as a modeling paradigm in large probabilistic models |
| title_fullStr | Separability as a modeling paradigm in large probabilistic models |
| title_full_unstemmed | Separability as a modeling paradigm in large probabilistic models |
| title_short | Separability as a modeling paradigm in large probabilistic models |
| title_sort | separability as a modeling paradigm in large probabilistic models |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/64586 |
| work_keys_str_mv | AT richouxwilliamjjrwilliamjoseph separabilityasamodelingparadigminlargeprobabilisticmodels |