Adaptive coding of action values in the human rostral cingulate zone.

Correctly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associat...

Full description

Bibliographic Details
Main Authors: Jocham, G, Neumann, J, Klein, T, Danielmeier, C, Ullsperger, M
Format: Journal article
Language:English
Published: 2009
_version_ 1797068764854878208
author Jocham, G
Neumann, J
Klein, T
Danielmeier, C
Ullsperger, M
author_facet Jocham, G
Neumann, J
Klein, T
Danielmeier, C
Ullsperger, M
author_sort Jocham, G
collection OXFORD
description Correctly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associations across multiple trials and in coding the subjective value of each action. During functional magnetic resonance imaging, healthy volunteers performed two versions of a probabilistic reversal learning task with high (HP) or low (LP) reward probabilities that required them to integrate action-outcome relations over lower or higher numbers of trials, respectively. In the HP session, subjects needed fewer trials to adjust their behavior in response to a reversal of response-reward contingencies. Similarly, the learning rate derived from a reinforcement learning model was higher in the HP condition. This was accompanied by a stronger response of the RCZ to negative feedback upon reversals in the HP condition. Furthermore, RCZ activity related to negative reward prediction errors varied as a function of the learning rate, which determines to what extent the prediction error is used to update action values. These data show that RCZ responses vary as a function of the information content provided by the environment. The more likely a negative event indicates the need for behavioral adaptations, the more prominent is the response of the RCZ. Thus, both the window of trials over which reinforcement information is integrated and adjustment of action values in the RCZ covary with the stochastics of the environment.
first_indexed 2024-03-06T22:14:48Z
format Journal article
id oxford-uuid:530537ec-6c8e-4139-b7b6-29bec4207edb
institution University of Oxford
language English
last_indexed 2024-03-06T22:14:48Z
publishDate 2009
record_format dspace
spelling oxford-uuid:530537ec-6c8e-4139-b7b6-29bec4207edb2022-03-26T16:29:07ZAdaptive coding of action values in the human rostral cingulate zone.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:530537ec-6c8e-4139-b7b6-29bec4207edbEnglishSymplectic Elements at Oxford2009Jocham, GNeumann, JKlein, TDanielmeier, CUllsperger, MCorrectly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associations across multiple trials and in coding the subjective value of each action. During functional magnetic resonance imaging, healthy volunteers performed two versions of a probabilistic reversal learning task with high (HP) or low (LP) reward probabilities that required them to integrate action-outcome relations over lower or higher numbers of trials, respectively. In the HP session, subjects needed fewer trials to adjust their behavior in response to a reversal of response-reward contingencies. Similarly, the learning rate derived from a reinforcement learning model was higher in the HP condition. This was accompanied by a stronger response of the RCZ to negative feedback upon reversals in the HP condition. Furthermore, RCZ activity related to negative reward prediction errors varied as a function of the learning rate, which determines to what extent the prediction error is used to update action values. These data show that RCZ responses vary as a function of the information content provided by the environment. The more likely a negative event indicates the need for behavioral adaptations, the more prominent is the response of the RCZ. Thus, both the window of trials over which reinforcement information is integrated and adjustment of action values in the RCZ covary with the stochastics of the environment.
spellingShingle Jocham, G
Neumann, J
Klein, T
Danielmeier, C
Ullsperger, M
Adaptive coding of action values in the human rostral cingulate zone.
title Adaptive coding of action values in the human rostral cingulate zone.
title_full Adaptive coding of action values in the human rostral cingulate zone.
title_fullStr Adaptive coding of action values in the human rostral cingulate zone.
title_full_unstemmed Adaptive coding of action values in the human rostral cingulate zone.
title_short Adaptive coding of action values in the human rostral cingulate zone.
title_sort adaptive coding of action values in the human rostral cingulate zone
work_keys_str_mv AT jochamg adaptivecodingofactionvaluesinthehumanrostralcingulatezone
AT neumannj adaptivecodingofactionvaluesinthehumanrostralcingulatezone
AT kleint adaptivecodingofactionvaluesinthehumanrostralcingulatezone
AT danielmeierc adaptivecodingofactionvaluesinthehumanrostralcingulatezone
AT ullspergerm adaptivecodingofactionvaluesinthehumanrostralcingulatezone