Hybrid predictive coding: Inferring, fast and slow.
Predictive coding is an influential model of cortical neural activity. It proposes that perceptual beliefs are furnished by sequentially minimising "prediction errors"-the differences between predicted and observed data. Implicit in this proposal is the idea that successful perception requ...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2023-08-01
|
| Series: | PLoS Computational Biology |
| Online Access: | https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011280&type=printable |
| _version_ | 1797303841147846656 |
|---|---|
| author | Alexander Tscshantz Beren Millidge Anil K Seth Christopher L Buckley |
| author_facet | Alexander Tscshantz Beren Millidge Anil K Seth Christopher L Buckley |
| author_sort | Alexander Tscshantz |
| collection | DOAJ |
| description | Predictive coding is an influential model of cortical neural activity. It proposes that perceptual beliefs are furnished by sequentially minimising "prediction errors"-the differences between predicted and observed data. Implicit in this proposal is the idea that successful perception requires multiple cycles of neural activity. This is at odds with evidence that several aspects of visual perception-including complex forms of object recognition-arise from an initial "feedforward sweep" that occurs on fast timescales which preclude substantial recurrent activity. Here, we propose that the feedforward sweep can be understood as performing amortized inference (applying a learned function that maps directly from data to beliefs) and recurrent processing can be understood as performing iterative inference (sequentially updating neural activity in order to improve the accuracy of beliefs). We propose a hybrid predictive coding network that combines both iterative and amortized inference in a principled manner by describing both in terms of a dual optimization of a single objective function. We show that the resulting scheme can be implemented in a biologically plausible neural architecture that approximates Bayesian inference utilising local Hebbian update rules. We demonstrate that our hybrid predictive coding model combines the benefits of both amortized and iterative inference-obtaining rapid and computationally cheap perceptual inference for familiar data while maintaining the context-sensitivity, precision, and sample efficiency of iterative inference schemes. Moreover, we show how our model is inherently sensitive to its uncertainty and adaptively balances iterative and amortized inference to obtain accurate beliefs using minimum computational expense. Hybrid predictive coding offers a new perspective on the functional relevance of the feedforward and recurrent activity observed during visual perception and offers novel insights into distinct aspects of visual phenomenology. |
| first_indexed | 2024-03-07T23:59:25Z |
| format | Article |
| id | doaj.art-05d5e3de8e504934954386a3c15e501c |
| institution | Directory Open Access Journal |
| issn | 1553-734X 1553-7358 |
| language | English |
| last_indexed | 2024-03-07T23:59:25Z |
| publishDate | 2023-08-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS Computational Biology |
| spelling | doaj.art-05d5e3de8e504934954386a3c15e501c2024-02-18T05:30:53ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582023-08-01198e101128010.1371/journal.pcbi.1011280Hybrid predictive coding: Inferring, fast and slow.Alexander TscshantzBeren MillidgeAnil K SethChristopher L BuckleyPredictive coding is an influential model of cortical neural activity. It proposes that perceptual beliefs are furnished by sequentially minimising "prediction errors"-the differences between predicted and observed data. Implicit in this proposal is the idea that successful perception requires multiple cycles of neural activity. This is at odds with evidence that several aspects of visual perception-including complex forms of object recognition-arise from an initial "feedforward sweep" that occurs on fast timescales which preclude substantial recurrent activity. Here, we propose that the feedforward sweep can be understood as performing amortized inference (applying a learned function that maps directly from data to beliefs) and recurrent processing can be understood as performing iterative inference (sequentially updating neural activity in order to improve the accuracy of beliefs). We propose a hybrid predictive coding network that combines both iterative and amortized inference in a principled manner by describing both in terms of a dual optimization of a single objective function. We show that the resulting scheme can be implemented in a biologically plausible neural architecture that approximates Bayesian inference utilising local Hebbian update rules. We demonstrate that our hybrid predictive coding model combines the benefits of both amortized and iterative inference-obtaining rapid and computationally cheap perceptual inference for familiar data while maintaining the context-sensitivity, precision, and sample efficiency of iterative inference schemes. Moreover, we show how our model is inherently sensitive to its uncertainty and adaptively balances iterative and amortized inference to obtain accurate beliefs using minimum computational expense. Hybrid predictive coding offers a new perspective on the functional relevance of the feedforward and recurrent activity observed during visual perception and offers novel insights into distinct aspects of visual phenomenology.https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011280&type=printable |
| spellingShingle | Alexander Tscshantz Beren Millidge Anil K Seth Christopher L Buckley Hybrid predictive coding: Inferring, fast and slow. PLoS Computational Biology |
| title | Hybrid predictive coding: Inferring, fast and slow. |
| title_full | Hybrid predictive coding: Inferring, fast and slow. |
| title_fullStr | Hybrid predictive coding: Inferring, fast and slow. |
| title_full_unstemmed | Hybrid predictive coding: Inferring, fast and slow. |
| title_short | Hybrid predictive coding: Inferring, fast and slow. |
| title_sort | hybrid predictive coding inferring fast and slow |
| url | https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011280&type=printable |
| work_keys_str_mv | AT alexandertscshantz hybridpredictivecodinginferringfastandslow AT berenmillidge hybridpredictivecodinginferringfastandslow AT anilkseth hybridpredictivecodinginferringfastandslow AT christopherlbuckley hybridpredictivecodinginferringfastandslow |