Stochastic architectures for probabilistic computation
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, 2014.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2014
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/87457 |
| _version_ | 1811089029790171136 |
|---|---|
| author | Jonas, Eric Michael |
| author2 | Joshua B. Tenenbaum. |
| author_facet | Joshua B. Tenenbaum. Jonas, Eric Michael |
| author_sort | Jonas, Eric Michael |
| collection | MIT |
| description | Thesis: Ph. D., Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, 2014. |
| first_indexed | 2024-09-23T14:12:43Z |
| format | Thesis |
| id | mit-1721.1/87457 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T14:12:43Z |
| publishDate | 2014 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/874572019-04-11T03:30:03Z Stochastic architectures for probabilistic computation Jonas, Eric Michael Joshua B. Tenenbaum. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences. Brain and Cognitive Sciences. Thesis: Ph. D., Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, 2014. Cataloged from PDF version of thesis. Includes bibliographical references (pages 107-111). The brain interprets ambiguous sensory information faster and more reliably than modern computers, using neurons that are slower and less reliable than logic gates. But Bayesian inference, which is at the heart of many models for sensory information processing and cognition, as well as many machine intelligence systems, appears computationally challenging, even given modern transistor speeds and energy budgets. The computational principles and structures needed to narrow this gap are unknown. Here I show how to build fast Bayesian computing machines using intentionally stochastic, digital parts, narrowing this efficiency gap by multiple orders of magnitude. By connecting stochastic digital components according to simple mathematical rules, it is possible to rapidly, reliably and accurately solve many Bayesian inference problems using massively parallel, low precision circuits. I show that our circuits can solve problems of depth and motion perception, perceptual learning and causal reasoning via inference over 10,000+ latent variables in real time - a 1,000x speed advantage over commodity microprocessors - by exploiting stochasticity. I will show how this natively stochastic approach follows naturally from the probability algebra, giving rise to easy-to-understand rules for abstraction and composition. I have developed a compiler that automatically generate circuits for a wide variety of problems fixed-structure problems. I then present stochastic computing architectures for models that are viable even when constrained by silicon area and dynamic creation and destruction of random variables. These results thus expose a new role for randomness and Bayesian inference in the engineering and reverse-engineering of computing machines. by Eric Jonas. Ph. D. 2014-05-23T19:33:07Z 2014-05-23T19:33:07Z 2014 2014 Thesis http://hdl.handle.net/1721.1/87457 879661588 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 111 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Brain and Cognitive Sciences. Jonas, Eric Michael Stochastic architectures for probabilistic computation |
| title | Stochastic architectures for probabilistic computation |
| title_full | Stochastic architectures for probabilistic computation |
| title_fullStr | Stochastic architectures for probabilistic computation |
| title_full_unstemmed | Stochastic architectures for probabilistic computation |
| title_short | Stochastic architectures for probabilistic computation |
| title_sort | stochastic architectures for probabilistic computation |
| topic | Brain and Cognitive Sciences. |
| url | http://hdl.handle.net/1721.1/87457 |
| work_keys_str_mv | AT jonasericmichael stochasticarchitecturesforprobabilisticcomputation |