Adaptive coding of action values in the human rostral cingulate zone.
Correctly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associat...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
2009
|
| _version_ | 1826272580585127936 |
|---|---|
| author | Jocham, G Neumann, J Klein, T Danielmeier, C Ullsperger, M |
| author_facet | Jocham, G Neumann, J Klein, T Danielmeier, C Ullsperger, M |
| author_sort | Jocham, G |
| collection | OXFORD |
| description | Correctly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associations across multiple trials and in coding the subjective value of each action. During functional magnetic resonance imaging, healthy volunteers performed two versions of a probabilistic reversal learning task with high (HP) or low (LP) reward probabilities that required them to integrate action-outcome relations over lower or higher numbers of trials, respectively. In the HP session, subjects needed fewer trials to adjust their behavior in response to a reversal of response-reward contingencies. Similarly, the learning rate derived from a reinforcement learning model was higher in the HP condition. This was accompanied by a stronger response of the RCZ to negative feedback upon reversals in the HP condition. Furthermore, RCZ activity related to negative reward prediction errors varied as a function of the learning rate, which determines to what extent the prediction error is used to update action values. These data show that RCZ responses vary as a function of the information content provided by the environment. The more likely a negative event indicates the need for behavioral adaptations, the more prominent is the response of the RCZ. Thus, both the window of trials over which reinforcement information is integrated and adjustment of action values in the RCZ covary with the stochastics of the environment. |
| first_indexed | 2024-03-06T22:14:48Z |
| format | Journal article |
| id | oxford-uuid:530537ec-6c8e-4139-b7b6-29bec4207edb |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T22:14:48Z |
| publishDate | 2009 |
| record_format | dspace |
| spelling | oxford-uuid:530537ec-6c8e-4139-b7b6-29bec4207edb2022-03-26T16:29:07ZAdaptive coding of action values in the human rostral cingulate zone.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:530537ec-6c8e-4139-b7b6-29bec4207edbEnglishSymplectic Elements at Oxford2009Jocham, GNeumann, JKlein, TDanielmeier, CUllsperger, MCorrectly selecting appropriate actions in an uncertain environment requires gathering experience about the available actions by sampling them over several trials. Recent findings suggest that the human rostral cingulate zone (RCZ) is important for the integration of extended action-outcome associations across multiple trials and in coding the subjective value of each action. During functional magnetic resonance imaging, healthy volunteers performed two versions of a probabilistic reversal learning task with high (HP) or low (LP) reward probabilities that required them to integrate action-outcome relations over lower or higher numbers of trials, respectively. In the HP session, subjects needed fewer trials to adjust their behavior in response to a reversal of response-reward contingencies. Similarly, the learning rate derived from a reinforcement learning model was higher in the HP condition. This was accompanied by a stronger response of the RCZ to negative feedback upon reversals in the HP condition. Furthermore, RCZ activity related to negative reward prediction errors varied as a function of the learning rate, which determines to what extent the prediction error is used to update action values. These data show that RCZ responses vary as a function of the information content provided by the environment. The more likely a negative event indicates the need for behavioral adaptations, the more prominent is the response of the RCZ. Thus, both the window of trials over which reinforcement information is integrated and adjustment of action values in the RCZ covary with the stochastics of the environment. |
| spellingShingle | Jocham, G Neumann, J Klein, T Danielmeier, C Ullsperger, M Adaptive coding of action values in the human rostral cingulate zone. |
| title | Adaptive coding of action values in the human rostral cingulate zone. |
| title_full | Adaptive coding of action values in the human rostral cingulate zone. |
| title_fullStr | Adaptive coding of action values in the human rostral cingulate zone. |
| title_full_unstemmed | Adaptive coding of action values in the human rostral cingulate zone. |
| title_short | Adaptive coding of action values in the human rostral cingulate zone. |
| title_sort | adaptive coding of action values in the human rostral cingulate zone |
| work_keys_str_mv | AT jochamg adaptivecodingofactionvaluesinthehumanrostralcingulatezone AT neumannj adaptivecodingofactionvaluesinthehumanrostralcingulatezone AT kleint adaptivecodingofactionvaluesinthehumanrostralcingulatezone AT danielmeierc adaptivecodingofactionvaluesinthehumanrostralcingulatezone AT ullspergerm adaptivecodingofactionvaluesinthehumanrostralcingulatezone |