Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex
In many natural environments the value of a choice gradually gets better or worse as circumstances change. Discerning such trends makes predicting future choice values possible. We show that humans track such trends by comparing estimates of recent and past reward rates, which they are able to hold...
| Asıl Yazarlar: | , , , , , , |
|---|---|
| Materyal Türü: | Journal article |
| Dil: | English |
| Baskı/Yayın Bilgisi: |
Nature Publishing Group
2016
|
| _version_ | 1826296113199579136 |
|---|---|
| author | Wittmann, M Kolling, N Akaishi, R Chau, B Brown, J Nelissen, N Rushworth, M |
| author_facet | Wittmann, M Kolling, N Akaishi, R Chau, B Brown, J Nelissen, N Rushworth, M |
| author_sort | Wittmann, M |
| collection | OXFORD |
| description | In many natural environments the value of a choice gradually gets better or worse as circumstances change. Discerning such trends makes predicting future choice values possible. We show that humans track such trends by comparing estimates of recent and past reward rates, which they are able to hold simultaneously in the dorsal anterior cingulate cortex (dACC). Comparison of recent and past reward rates with positive and negative decision weights is reflected by opposing dACC signals indexing these quantities. The relative strengths of time-linked reward representations in dACC predict whether subjects persist in their current behaviour or switch to an alternative. Computationally, trend-guided choice can be modelled by using a reinforcement-learning mechanism that computes a longer-term estimate (or expectation) of prediction errors. Using such a model, we find a relative predominance of expected prediction errors in dACC, instantaneous prediction errors in the ventral striatum and choice signals in the ventromedial prefrontal cortex. |
| first_indexed | 2024-03-07T04:11:21Z |
| format | Journal article |
| id | oxford-uuid:c7ec9da0-c07c-4657-aa37-b062218bfab7 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T04:11:21Z |
| publishDate | 2016 |
| publisher | Nature Publishing Group |
| record_format | dspace |
| spelling | oxford-uuid:c7ec9da0-c07c-4657-aa37-b062218bfab72022-03-27T06:48:42ZPredictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortexJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:c7ec9da0-c07c-4657-aa37-b062218bfab7EnglishSymplectic Elements at OxfordNature Publishing Group2016Wittmann, MKolling, NAkaishi, RChau, BBrown, JNelissen, NRushworth, MIn many natural environments the value of a choice gradually gets better or worse as circumstances change. Discerning such trends makes predicting future choice values possible. We show that humans track such trends by comparing estimates of recent and past reward rates, which they are able to hold simultaneously in the dorsal anterior cingulate cortex (dACC). Comparison of recent and past reward rates with positive and negative decision weights is reflected by opposing dACC signals indexing these quantities. The relative strengths of time-linked reward representations in dACC predict whether subjects persist in their current behaviour or switch to an alternative. Computationally, trend-guided choice can be modelled by using a reinforcement-learning mechanism that computes a longer-term estimate (or expectation) of prediction errors. Using such a model, we find a relative predominance of expected prediction errors in dACC, instantaneous prediction errors in the ventral striatum and choice signals in the ventromedial prefrontal cortex. |
| spellingShingle | Wittmann, M Kolling, N Akaishi, R Chau, B Brown, J Nelissen, N Rushworth, M Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex |
| title | Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex |
| title_full | Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex |
| title_fullStr | Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex |
| title_full_unstemmed | Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex |
| title_short | Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex |
| title_sort | predictive decision making driven by multiple time linked reward representations in the anterior cingulate cortex |
| work_keys_str_mv | AT wittmannm predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex AT kollingn predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex AT akaishir predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex AT chaub predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex AT brownj predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex AT nelissenn predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex AT rushworthm predictivedecisionmakingdrivenbymultipletimelinkedrewardrepresentationsintheanteriorcingulatecortex |