Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference
Dopamine is implicated in representing model-free (MF) reward prediction errors a as well as influencing model-based (MB) credit assignment and choice. Putative cooperative interactions between MB and MF systems include a guidance of MF credit assignment by MB inference. Here, we used a double-blind...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
eLife Sciences Publications Ltd
2021-12-01
|
| Series: | eLife |
| Subjects: | |
| Online Access: | https://elifesciences.org/articles/67778 |
| _version_ | 1811199707542716416 |
|---|---|
| author | Lorenz Deserno Rani Moran Jochen Michely Ying Lee Peter Dayan Raymond J Dolan |
| author_facet | Lorenz Deserno Rani Moran Jochen Michely Ying Lee Peter Dayan Raymond J Dolan |
| author_sort | Lorenz Deserno |
| collection | DOAJ |
| description | Dopamine is implicated in representing model-free (MF) reward prediction errors a as well as influencing model-based (MB) credit assignment and choice. Putative cooperative interactions between MB and MF systems include a guidance of MF credit assignment by MB inference. Here, we used a double-blind, placebo-controlled, within-subjects design to test an hypothesis that enhancing dopamine levels boosts the guidance of MF credit assignment by MB inference. In line with this, we found that levodopa enhanced guidance of MF credit assignment by MB inference, without impacting MF and MB influences directly. This drug effect correlated negatively with a dopamine-dependent change in purely MB credit assignment, possibly reflecting a trade-off between these two MB components of behavioural control. Our findings of a dopamine boost in MB inference guidance of MF learning highlight a novel DA influence on MB-MF cooperative interactions. |
| first_indexed | 2024-04-12T01:51:55Z |
| format | Article |
| id | doaj.art-aa600219a1fe47b587869aa6a32dff0e |
| institution | Directory Open Access Journal |
| issn | 2050-084X |
| language | English |
| last_indexed | 2024-04-12T01:51:55Z |
| publishDate | 2021-12-01 |
| publisher | eLife Sciences Publications Ltd |
| record_format | Article |
| series | eLife |
| spelling | doaj.art-aa600219a1fe47b587869aa6a32dff0e2022-12-22T03:52:55ZengeLife Sciences Publications LtdeLife2050-084X2021-12-011010.7554/eLife.67778Dopamine enhances model-free credit assignment through boosting of retrospective model-based inferenceLorenz Deserno0https://orcid.org/0000-0001-7392-5280Rani Moran1https://orcid.org/0000-0002-7641-2402Jochen Michely2https://orcid.org/0000-0003-3072-2330Ying Lee3https://orcid.org/0000-0001-9491-4919Peter Dayan4https://orcid.org/0000-0003-3476-1839Raymond J Dolan5https://orcid.org/0000-0001-9356-761XMax Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, United Kingdom; Department of Child and Adolescent Psychiatry, Psychotherapy and Psychosomatics, University of Würzburg, Würzburg, Germany; Department of Psychiatry and Psychotherapy, Technische Universität Dresden, Dresden, GermanyMax Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, United KingdomMax Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, United Kingdom; Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin Berlin, Berlin, GermanyMax Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, United Kingdom; Department of Psychiatry and Psychotherapy, Technische Universität Dresden, Dresden, GermanyMax Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; Max Planck Institute for Biological Cybernetics, Tübingen, Germany; University of Tübingen, Tübingen, GermanyMax Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, United Kingdom; The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, United KingdomDopamine is implicated in representing model-free (MF) reward prediction errors a as well as influencing model-based (MB) credit assignment and choice. Putative cooperative interactions between MB and MF systems include a guidance of MF credit assignment by MB inference. Here, we used a double-blind, placebo-controlled, within-subjects design to test an hypothesis that enhancing dopamine levels boosts the guidance of MF credit assignment by MB inference. In line with this, we found that levodopa enhanced guidance of MF credit assignment by MB inference, without impacting MF and MB influences directly. This drug effect correlated negatively with a dopamine-dependent change in purely MB credit assignment, possibly reflecting a trade-off between these two MB components of behavioural control. Our findings of a dopamine boost in MB inference guidance of MF learning highlight a novel DA influence on MB-MF cooperative interactions.https://elifesciences.org/articles/67778dopaminereinforcement learningmodel-free/model-based |
| spellingShingle | Lorenz Deserno Rani Moran Jochen Michely Ying Lee Peter Dayan Raymond J Dolan Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference eLife dopamine reinforcement learning model-free/model-based |
| title | Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference |
| title_full | Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference |
| title_fullStr | Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference |
| title_full_unstemmed | Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference |
| title_short | Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference |
| title_sort | dopamine enhances model free credit assignment through boosting of retrospective model based inference |
| topic | dopamine reinforcement learning model-free/model-based |
| url | https://elifesciences.org/articles/67778 |
| work_keys_str_mv | AT lorenzdeserno dopamineenhancesmodelfreecreditassignmentthroughboostingofretrospectivemodelbasedinference AT ranimoran dopamineenhancesmodelfreecreditassignmentthroughboostingofretrospectivemodelbasedinference AT jochenmichely dopamineenhancesmodelfreecreditassignmentthroughboostingofretrospectivemodelbasedinference AT yinglee dopamineenhancesmodelfreecreditassignmentthroughboostingofretrospectivemodelbasedinference AT peterdayan dopamineenhancesmodelfreecreditassignmentthroughboostingofretrospectivemodelbasedinference AT raymondjdolan dopamineenhancesmodelfreecreditassignmentthroughboostingofretrospectivemodelbasedinference |