The role of efference copy in striatal learning
Reinforcement learning requires the convergence of signals representing context, action, and reward. While models of basal ganglia function have well-founded hypotheses about the neural origin of signals representing context and reward, the function and origin of signals representing action are less...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Elsevier
2016
|
| Online Access: | http://hdl.handle.net/1721.1/102410 https://orcid.org/0000-0001-7539-1745 |
| _version_ | 1826203176203714560 |
|---|---|
| author | Fee, Michale S. |
| author2 | Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences |
| author_facet | Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Fee, Michale S. |
| author_sort | Fee, Michale S. |
| collection | MIT |
| description | Reinforcement learning requires the convergence of signals representing context, action, and reward. While models of basal ganglia function have well-founded hypotheses about the neural origin of signals representing context and reward, the function and origin of signals representing action are less clear. Recent findings suggest that exploratory or variable behaviors are initiated by a wide array of ‘action-generating’ circuits in the midbrain, brainstem, and cortex. Thus, in order to learn, the striatum must incorporate an efference copy of action decisions made in these action-generating circuits. Here we review several recent neural models of reinforcement learning that emphasize the role of efference copy signals. Also described are ideas about how these signals might be integrated with inputs signaling context and reward. |
| first_indexed | 2024-09-23T12:32:45Z |
| format | Article |
| id | mit-1721.1/102410 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T12:32:45Z |
| publishDate | 2016 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | mit-1721.1/1024102022-09-28T08:28:58Z The role of efference copy in striatal learning Fee, Michale S. Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences McGovern Institute for Brain Research at MIT Fee, Michale S. Reinforcement learning requires the convergence of signals representing context, action, and reward. While models of basal ganglia function have well-founded hypotheses about the neural origin of signals representing context and reward, the function and origin of signals representing action are less clear. Recent findings suggest that exploratory or variable behaviors are initiated by a wide array of ‘action-generating’ circuits in the midbrain, brainstem, and cortex. Thus, in order to learn, the striatum must incorporate an efference copy of action decisions made in these action-generating circuits. Here we review several recent neural models of reinforcement learning that emphasize the role of efference copy signals. Also described are ideas about how these signals might be integrated with inputs signaling context and reward. National Institutes of Health (U.S.) (Grant R01MH067105) 2016-05-04T23:47:30Z 2016-05-04T23:47:30Z 2014-02 Article http://purl.org/eprint/type/JournalArticle 09594388 http://hdl.handle.net/1721.1/102410 Fee, Michale S. “The Role of Efference Copy in Striatal Learning.” Current Opinion in Neurobiology 25 (April 2014): 194–200. https://orcid.org/0000-0001-7539-1745 en_US http://dx.doi.org/10.1016/j.conb.2014.01.012 Current Opinion in Neurobiology Creative Commons Attribution-NonCommercial-NoDerivs License http://creativecommons.org/licenses/by-nc-nd/4.0/ application/pdf Elsevier PMC |
| spellingShingle | Fee, Michale S. The role of efference copy in striatal learning |
| title | The role of efference copy in striatal learning |
| title_full | The role of efference copy in striatal learning |
| title_fullStr | The role of efference copy in striatal learning |
| title_full_unstemmed | The role of efference copy in striatal learning |
| title_short | The role of efference copy in striatal learning |
| title_sort | role of efference copy in striatal learning |
| url | http://hdl.handle.net/1721.1/102410 https://orcid.org/0000-0001-7539-1745 |
| work_keys_str_mv | AT feemichales theroleofefferencecopyinstriatallearning AT feemichales roleofefferencecopyinstriatallearning |