Pramipexole enhances reward learning by preserving value estimates
<p><strong>Background:</strong> Dopamine D<sub>2</sub>-like agonists show promise as treatments for depression. They are thought to act by enhancing reward learning; however, the mechanisms by which they achieve this are not clear. Reinforcement learning accounts descri...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Elsevier
2023
|
| _version_ | 1797112426075783168 |
|---|---|
| author | Halahakoon, DC Kaltenboeck, A Martens, M Geddes, JG Harmer, CJ Cowen, P Browning, M |
| author_facet | Halahakoon, DC Kaltenboeck, A Martens, M Geddes, JG Harmer, CJ Cowen, P Browning, M |
| author_sort | Halahakoon, DC |
| collection | OXFORD |
| description | <p><strong>Background:</strong> Dopamine D<sub>2</sub>-like agonists show promise as treatments for depression. They are thought to act by enhancing reward learning; however, the mechanisms by which they achieve this are not clear. Reinforcement learning accounts describe 3 distinct candidate mechanisms: increased reward sensitivity, increased inverse decision–temperature, and decreased value decay. As these mechanisms produce equivalent effects on behavior, arbitrating between them requires measurement of how expectations and prediction errors are altered. We characterized the effects of 2 weeks of the D<sub>2</sub>-like agonist pramipexole on reward learning and used functional magnetic resonance imaging measures of expectation and prediction error to assess which of these 3 mechanistic processes were responsible for the behavioral effects.</p>
<p><strong>Methods:</strong> Forty healthy volunteers (50% female) were randomized to 2 weeks of pramipexole (titrated to 1 mg/day) or placebo in a double-blind, between-subject design. Participants completed a probabilistic instrumental learning task before and after the pharmacological intervention, with functional magnetic resonance imaging data collected at the second visit. Asymptotic choice accuracy and a reinforcement learning model were used to assess reward learning.</p>
<p><strong>Results:</strong> Pramipexole increased choice accuracy in the reward condition with no effect on losses. Participants who received pramipexole had increased blood oxygen level–dependent response in the orbital frontal cortex during the expectation of win trials but decreased blood oxygen level–dependent response to reward prediction errors in the ventromedial prefrontal cortex. This pattern of results indicates that pramipexole enhances choice accuracy by reducing the decay of estimated values during reward learning.</p>
<p><strong>Conclusions:</strong> The D<sub>2</sub>-like receptor agonist pramipexole enhances reward learning by preserving learned values. This is a plausible mechanism for pramipexole’s antidepressant effect.</p> |
| first_indexed | 2024-03-07T08:25:35Z |
| format | Journal article |
| id | oxford-uuid:07c85072-3d88-4294-96da-200fdbd4f9db |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T08:25:35Z |
| publishDate | 2023 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:07c85072-3d88-4294-96da-200fdbd4f9db2024-02-14T15:46:28ZPramipexole enhances reward learning by preserving value estimatesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:07c85072-3d88-4294-96da-200fdbd4f9dbEnglishSymplectic ElementsElsevier2023Halahakoon, DCKaltenboeck, AMartens, MGeddes, JGHarmer, CJCowen, PBrowning, M<p><strong>Background:</strong> Dopamine D<sub>2</sub>-like agonists show promise as treatments for depression. They are thought to act by enhancing reward learning; however, the mechanisms by which they achieve this are not clear. Reinforcement learning accounts describe 3 distinct candidate mechanisms: increased reward sensitivity, increased inverse decision–temperature, and decreased value decay. As these mechanisms produce equivalent effects on behavior, arbitrating between them requires measurement of how expectations and prediction errors are altered. We characterized the effects of 2 weeks of the D<sub>2</sub>-like agonist pramipexole on reward learning and used functional magnetic resonance imaging measures of expectation and prediction error to assess which of these 3 mechanistic processes were responsible for the behavioral effects.</p> <p><strong>Methods:</strong> Forty healthy volunteers (50% female) were randomized to 2 weeks of pramipexole (titrated to 1 mg/day) or placebo in a double-blind, between-subject design. Participants completed a probabilistic instrumental learning task before and after the pharmacological intervention, with functional magnetic resonance imaging data collected at the second visit. Asymptotic choice accuracy and a reinforcement learning model were used to assess reward learning.</p> <p><strong>Results:</strong> Pramipexole increased choice accuracy in the reward condition with no effect on losses. Participants who received pramipexole had increased blood oxygen level–dependent response in the orbital frontal cortex during the expectation of win trials but decreased blood oxygen level–dependent response to reward prediction errors in the ventromedial prefrontal cortex. This pattern of results indicates that pramipexole enhances choice accuracy by reducing the decay of estimated values during reward learning.</p> <p><strong>Conclusions:</strong> The D<sub>2</sub>-like receptor agonist pramipexole enhances reward learning by preserving learned values. This is a plausible mechanism for pramipexole’s antidepressant effect.</p> |
| spellingShingle | Halahakoon, DC Kaltenboeck, A Martens, M Geddes, JG Harmer, CJ Cowen, P Browning, M Pramipexole enhances reward learning by preserving value estimates |
| title | Pramipexole enhances reward learning by preserving value estimates |
| title_full | Pramipexole enhances reward learning by preserving value estimates |
| title_fullStr | Pramipexole enhances reward learning by preserving value estimates |
| title_full_unstemmed | Pramipexole enhances reward learning by preserving value estimates |
| title_short | Pramipexole enhances reward learning by preserving value estimates |
| title_sort | pramipexole enhances reward learning by preserving value estimates |
| work_keys_str_mv | AT halahakoondc pramipexoleenhancesrewardlearningbypreservingvalueestimates AT kaltenboecka pramipexoleenhancesrewardlearningbypreservingvalueestimates AT martensm pramipexoleenhancesrewardlearningbypreservingvalueestimates AT geddesjg pramipexoleenhancesrewardlearningbypreservingvalueestimates AT harmercj pramipexoleenhancesrewardlearningbypreservingvalueestimates AT cowenp pramipexoleenhancesrewardlearningbypreservingvalueestimates AT browningm pramipexoleenhancesrewardlearningbypreservingvalueestimates |