Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules
Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2018-07-01
|
| Series: | Frontiers in Neural Circuits |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fncir.2018.00053/full |
| _version_ | 1818951854108704768 |
|---|---|
| author | Wulfram Gerstner Marco Lehmann Vasiliki Liakoni Dane Corneil Johanni Brea |
| author_facet | Wulfram Gerstner Marco Lehmann Vasiliki Liakoni Dane Corneil Johanni Brea |
| author_sort | Wulfram Gerstner |
| collection | DOAJ |
| description | Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules. |
| first_indexed | 2024-12-20T09:41:06Z |
| format | Article |
| id | doaj.art-f69fae29b38e461ab6a8bab5385ce33e |
| institution | Directory Open Access Journal |
| issn | 1662-5110 |
| language | English |
| last_indexed | 2024-12-20T09:41:06Z |
| publishDate | 2018-07-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neural Circuits |
| spelling | doaj.art-f69fae29b38e461ab6a8bab5385ce33e2022-12-21T19:44:53ZengFrontiers Media S.A.Frontiers in Neural Circuits1662-51102018-07-011210.3389/fncir.2018.00053350307Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning RulesWulfram GerstnerMarco LehmannVasiliki LiakoniDane CorneilJohanni BreaMost elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.https://www.frontiersin.org/article/10.3389/fncir.2018.00053/fulleligibility tracehebb rulereinforcement learningneuromodulatorssurprisesynaptic tagging |
| spellingShingle | Wulfram Gerstner Marco Lehmann Vasiliki Liakoni Dane Corneil Johanni Brea Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules Frontiers in Neural Circuits eligibility trace hebb rule reinforcement learning neuromodulators surprise synaptic tagging |
| title | Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules |
| title_full | Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules |
| title_fullStr | Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules |
| title_full_unstemmed | Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules |
| title_short | Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules |
| title_sort | eligibility traces and plasticity on behavioral time scales experimental support of neohebbian three factor learning rules |
| topic | eligibility trace hebb rule reinforcement learning neuromodulators surprise synaptic tagging |
| url | https://www.frontiersin.org/article/10.3389/fncir.2018.00053/full |
| work_keys_str_mv | AT wulframgerstner eligibilitytracesandplasticityonbehavioraltimescalesexperimentalsupportofneohebbianthreefactorlearningrules AT marcolehmann eligibilitytracesandplasticityonbehavioraltimescalesexperimentalsupportofneohebbianthreefactorlearningrules AT vasilikiliakoni eligibilitytracesandplasticityonbehavioraltimescalesexperimentalsupportofneohebbianthreefactorlearningrules AT danecorneil eligibilitytracesandplasticityonbehavioraltimescalesexperimentalsupportofneohebbianthreefactorlearningrules AT johannibrea eligibilitytracesandplasticityonbehavioraltimescalesexperimentalsupportofneohebbianthreefactorlearningrules |