Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales
Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behaviour and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strat...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2013-10-01
|
| Series: | Frontiers in Neuroscience |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00175/full |
| _version_ | 1798046102424911872 |
|---|---|
| author | Mathieu eBaudonnat Anna eHuber Anna eHuber Vincent eDavid Mark Edwin Walton |
| author_facet | Mathieu eBaudonnat Anna eHuber Anna eHuber Vincent eDavid Mark Edwin Walton |
| author_sort | Mathieu eBaudonnat |
| collection | DOAJ |
| description | Dopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behaviour and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviourally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioural uncertainty. |
| first_indexed | 2024-04-11T23:32:05Z |
| format | Article |
| id | doaj.art-1bf7b00480e74931958a8a58095796fa |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-04-11T23:32:05Z |
| publishDate | 2013-10-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-1bf7b00480e74931958a8a58095796fa2022-12-22T03:57:04ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2013-10-01710.3389/fnins.2013.0017562678Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescalesMathieu eBaudonnat0Anna eHuber1Anna eHuber2Vincent eDavid3Mark Edwin Walton4University of OxfordUniversity of OxfordUniversity of OxfordUniversité de Bordeaux and Institut de Neurosciences Cognitives et Intégratives d'AquitaineUniversity of OxfordDopamine has long been tightly associated with aspects of reinforcement learning and motivation in simple situations where there are a limited number of stimuli to guide behaviour and constrained range of outcomes. In naturalistic situations, however, there are many potential cues and foraging strategies that could be adopted, and it is critical that animals determine what might be behaviourally relevant in such complex environments. This requires not only detecting discrepancies with what they have recently experienced, but also identifying similarities with past experiences stored in memory. Here, we review what role dopamine might play in determining how and when to learn about the world, and how to develop choice policies appropriate to the situation faced. We discuss evidence that dopamine is shaped by motivation and memory and in turn shapes reward-based memory formation. In particular, we suggest that hippocampal-striatal-dopamine networks may interact to determine how surprising the world is and to either inhibit or promote actions at time of behavioural uncertainty.http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00175/fullDopamineHippocampusMotivationNucleus Accumbensreinforcement learningReward |
| spellingShingle | Mathieu eBaudonnat Anna eHuber Anna eHuber Vincent eDavid Mark Edwin Walton Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales Frontiers in Neuroscience Dopamine Hippocampus Motivation Nucleus Accumbens reinforcement learning Reward |
| title | Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales |
| title_full | Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales |
| title_fullStr | Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales |
| title_full_unstemmed | Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales |
| title_short | Heads for learning, tails for memory: Reward, reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales |
| title_sort | heads for learning tails for memory reward reinforcement and a role of dopamine in determining behavioural relevance across multiple timescales |
| topic | Dopamine Hippocampus Motivation Nucleus Accumbens reinforcement learning Reward |
| url | http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00175/full |
| work_keys_str_mv | AT mathieuebaudonnat headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehaviouralrelevanceacrossmultipletimescales AT annaehuber headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehaviouralrelevanceacrossmultipletimescales AT annaehuber headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehaviouralrelevanceacrossmultipletimescales AT vincentedavid headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehaviouralrelevanceacrossmultipletimescales AT markedwinwalton headsforlearningtailsformemoryrewardreinforcementandaroleofdopamineindeterminingbehaviouralrelevanceacrossmultipletimescales |