Learning reward timing in cortex through reward dependent expression of synaptic plasticity
The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representat...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
National Academy of Sciences
2009
|
| Online Access: | http://hdl.handle.net/1721.1/50255 |
| _version_ | 1826210000450617344 |
|---|---|
| author | Gavornik, Jeffrey Shuler, Marshal G. Hussain Loewenstein, Yonatan Bear, Mark Shouval, Harel Z. |
| author2 | Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences |
| author_facet | Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Gavornik, Jeffrey Shuler, Marshal G. Hussain Loewenstein, Yonatan Bear, Mark Shouval, Harel Z. |
| author_sort | Gavornik, Jeffrey |
| collection | MIT |
| description | The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions. |
| first_indexed | 2024-09-23T14:39:30Z |
| format | Article |
| id | mit-1721.1/50255 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T14:39:30Z |
| publishDate | 2009 |
| publisher | National Academy of Sciences |
| record_format | dspace |
| spelling | mit-1721.1/502552022-09-29T10:02:34Z Learning reward timing in cortex through reward dependent expression of synaptic plasticity Gavornik, Jeffrey Shuler, Marshal G. Hussain Loewenstein, Yonatan Bear, Mark Shouval, Harel Z. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Picower Institute for Learning and Memory Bear, Mark Bear, Mark The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions. Israel Science Foundation Howard Hughes Medical Institute National Science Foundation Collaborative Research in Computational Neuroscience 2009-12-28T16:36:45Z 2009-12-28T16:36:45Z 2009-04 2008-12 Article http://purl.org/eprint/type/JournalArticle 0027-8424 http://hdl.handle.net/1721.1/50255 Gavornik, Jeffrey P et al. “Learning reward timing in cortex through reward dependent expression of synaptic plasticity.” Proceedings of the National Academy of Sciences 106.16 (2009): 6826-6831. 19346478 en_US http://dx.doi.org/10.1073/pnas.0901835106 Proceedings of the National Academy of Sciences of the United States of America Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf National Academy of Sciences PNAS |
| spellingShingle | Gavornik, Jeffrey Shuler, Marshal G. Hussain Loewenstein, Yonatan Bear, Mark Shouval, Harel Z. Learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| title | Learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| title_full | Learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| title_fullStr | Learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| title_full_unstemmed | Learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| title_short | Learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| title_sort | learning reward timing in cortex through reward dependent expression of synaptic plasticity |
| url | http://hdl.handle.net/1721.1/50255 |
| work_keys_str_mv | AT gavornikjeffrey learningrewardtimingincortexthroughrewarddependentexpressionofsynapticplasticity AT shulermarshalghussain learningrewardtimingincortexthroughrewarddependentexpressionofsynapticplasticity AT loewensteinyonatan learningrewardtimingincortexthroughrewarddependentexpressionofsynapticplasticity AT bearmark learningrewardtimingincortexthroughrewarddependentexpressionofsynapticplasticity AT shouvalharelz learningrewardtimingincortexthroughrewarddependentexpressionofsynapticplasticity |