Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific

Neural correlates of reward prediction errors (RPEs) have been found in dorsal striatum. Such signals may be important for updating associative action representations within striatum. In order that the appropriate representations can be updated, it might be important for the RPE signal to be specifi...

Full description

Bibliographic Details
Main Authors: Ogawa, Masaaki, Stalnaker, Thomas A., Calhoon, Gwendolyn G., Roesch, Matthew R., Schoenbaum, Geoffrey
Other Authors: Massachusetts Institute of Technology. Media Laboratory
Format: Article
Language:en_US
Published: Society for Neuroscience 2013
Online Access:http://hdl.handle.net/1721.1/76756
_version_ 1826190641794646016
author Ogawa, Masaaki
Stalnaker, Thomas A.
Calhoon, Gwendolyn G.
Roesch, Matthew R.
Schoenbaum, Geoffrey
author2 Massachusetts Institute of Technology. Media Laboratory
author_facet Massachusetts Institute of Technology. Media Laboratory
Ogawa, Masaaki
Stalnaker, Thomas A.
Calhoon, Gwendolyn G.
Roesch, Matthew R.
Schoenbaum, Geoffrey
author_sort Ogawa, Masaaki
collection MIT
description Neural correlates of reward prediction errors (RPEs) have been found in dorsal striatum. Such signals may be important for updating associative action representations within striatum. In order that the appropriate representations can be updated, it might be important for the RPE signal to be specific for the action that led to that error. However, RPEs signaled by midbrain dopamine neurons, which project heavily to striatum, are not action-specific. Here we tested whether RPE-like activity in dorsal striatum is action-specific; we recorded single-unit activity in posterior dorsomedial and dorsolateral striatum as rats performed a task in which the reward predictions associated with two different actions were repeatedly violated, thereby eliciting RPEs. We separately analyzed fast firing neurons (FFNs) and phasically firing neurons (total n = 1076). Only among FFNs recorded in posterior dorsomedial striatum did we find a population with RPE-like characteristics (19 of all 196 FFNs, 10%). This population showed a phasic increase in activity during unexpected rewards, a phasic decrease in activity during unexpected omission of rewards, and a phasic increase in activity during cues when they predicted high-value reward. However, unlike a classical RPE signal, this signal was linked to the action that elicited the prediction error, in that neurons tended to signal RPEs only after their anti-preferred action. This action-specific RPE-like signal could provide a mechanism for updating specific associative action representations in posterior dorsomedial striatum.
first_indexed 2024-09-23T08:43:27Z
format Article
id mit-1721.1/76756
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T08:43:27Z
publishDate 2013
publisher Society for Neuroscience
record_format dspace
spelling mit-1721.1/767562022-09-30T10:44:32Z Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific Ogawa, Masaaki Stalnaker, Thomas A. Calhoon, Gwendolyn G. Roesch, Matthew R. Schoenbaum, Geoffrey Massachusetts Institute of Technology. Media Laboratory Ogawa, Masaaki Neural correlates of reward prediction errors (RPEs) have been found in dorsal striatum. Such signals may be important for updating associative action representations within striatum. In order that the appropriate representations can be updated, it might be important for the RPE signal to be specific for the action that led to that error. However, RPEs signaled by midbrain dopamine neurons, which project heavily to striatum, are not action-specific. Here we tested whether RPE-like activity in dorsal striatum is action-specific; we recorded single-unit activity in posterior dorsomedial and dorsolateral striatum as rats performed a task in which the reward predictions associated with two different actions were repeatedly violated, thereby eliciting RPEs. We separately analyzed fast firing neurons (FFNs) and phasically firing neurons (total n = 1076). Only among FFNs recorded in posterior dorsomedial striatum did we find a population with RPE-like characteristics (19 of all 196 FFNs, 10%). This population showed a phasic increase in activity during unexpected rewards, a phasic decrease in activity during unexpected omission of rewards, and a phasic increase in activity during cues when they predicted high-value reward. However, unlike a classical RPE signal, this signal was linked to the action that elicited the prediction error, in that neurons tended to signal RPEs only after their anti-preferred action. This action-specific RPE-like signal could provide a mechanism for updating specific associative action representations in posterior dorsomedial striatum. 2013-02-06T20:44:50Z 2013-02-06T20:44:50Z 2012-07 2012-05 Article http://purl.org/eprint/type/JournalArticle 0270-6474 1529-2401 http://hdl.handle.net/1721.1/76756 Stalnaker, T. A. et al. “Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific.” Journal of Neuroscience 32.30 (2012): 10296–10305. © 2012 by the Society for Neuroscience en_US http://dx.doi.org/10.1523/jneurosci.0832-12.2012 Journal of Neuroscience Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf Society for Neuroscience SFN
spellingShingle Ogawa, Masaaki
Stalnaker, Thomas A.
Calhoon, Gwendolyn G.
Roesch, Matthew R.
Schoenbaum, Geoffrey
Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific
title Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific
title_full Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific
title_fullStr Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific
title_full_unstemmed Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific
title_short Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific
title_sort reward prediction error signaling in posterior dorsomedial striatum is action specific
url http://hdl.handle.net/1721.1/76756
work_keys_str_mv AT ogawamasaaki rewardpredictionerrorsignalinginposteriordorsomedialstriatumisactionspecific
AT stalnakerthomasa rewardpredictionerrorsignalinginposteriordorsomedialstriatumisactionspecific
AT calhoongwendolyng rewardpredictionerrorsignalinginposteriordorsomedialstriatumisactionspecific
AT roeschmatthewr rewardpredictionerrorsignalinginposteriordorsomedialstriatumisactionspecific
AT schoenbaumgeoffrey rewardpredictionerrorsignalinginposteriordorsomedialstriatumisactionspecific