Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence

Substance-dependent individuals often lack the ability to adjust decisions flexibly in response to the changes in reward contingencies. Prediction errors (PEs) are thought to mediate flexible decision-making by updating the reward values associated with available actions. In this study, we explored...

Full description

Bibliographic Details
Main Authors: Sinem Balta Beylergil, Anne Beck, Lorenz Deserno, Robert C. Lorenz, Michael A. Rapp, Florian Schlagenhauf, Andreas Heinz, Klaus Obermayer
Format: Article
Language:English
Published: Elsevier 2017-01-01
Series:NeuroImage: Clinical
Online Access:http://www.sciencedirect.com/science/article/pii/S2213158217300876
_version_ 1828532569873842176
author Sinem Balta Beylergil
Anne Beck
Lorenz Deserno
Robert C. Lorenz
Michael A. Rapp
Florian Schlagenhauf
Andreas Heinz
Klaus Obermayer
author_facet Sinem Balta Beylergil
Anne Beck
Lorenz Deserno
Robert C. Lorenz
Michael A. Rapp
Florian Schlagenhauf
Andreas Heinz
Klaus Obermayer
author_sort Sinem Balta Beylergil
collection DOAJ
description Substance-dependent individuals often lack the ability to adjust decisions flexibly in response to the changes in reward contingencies. Prediction errors (PEs) are thought to mediate flexible decision-making by updating the reward values associated with available actions. In this study, we explored whether the neurobiological correlates of PEs are altered in alcohol dependence. Behavioral, and functional magnetic resonance imaging (fMRI) data were simultaneously acquired from 34 abstinent alcohol-dependent patients (ADP) and 26 healthy controls (HC) during a probabilistic reward-guided decision-making task with dynamically changing reinforcement contingencies. A hierarchical Bayesian inference method was used to fit and compare learning models with different assumptions about the amount of task-related information subjects may have inferred during the experiment. Here, we observed that the best-fitting model was a modified Rescorla-Wagner type model, the “double-update” model, which assumes that subjects infer the knowledge that reward contingencies are anti-correlated, and integrate both actual and hypothetical outcomes into their decisions. Moreover, comparison of the best-fitting model's parameters showed that ADP were less sensitive to punishments compared to HC. Hence, decisions of ADP after punishments were loosely coupled with the expected reward values assigned to them. A correlation analysis between the model-generated PEs and the fMRI data revealed a reduced association between these PEs and the BOLD activity in the dorsolateral prefrontal cortex (DLPFC) of ADP. A hemispheric asymmetry was observed in the DLPFC when positive and negative PE signals were analyzed separately. The right DLPFC activity in ADP showed a reduced correlation with positive PEs. On the other hand, ADP, particularly the patients with high dependence severity, recruited the left DLPFC to a lesser extent than HC for processing negative PE signals. These results suggest that the DLPFC, which has been linked to adaptive control of action selection, may play an important role in cognitive inflexibility observed in alcohol dependence when reinforcement contingencies change. Particularly, the left DLPFC may contribute to this impaired behavioral adaptation, possibly by impeding the extinction of the actions that no longer lead to a reward. Keywords: Alcohol dependence, Prediction error, Reinforcement learning, Reversal learning, Dorsolateral prefrontal cortex, Decision-making
first_indexed 2024-12-11T22:54:59Z
format Article
id doaj.art-e4b84c87da414243b8bcabb810ea9a07
institution Directory Open Access Journal
issn 2213-1582
language English
last_indexed 2024-12-11T22:54:59Z
publishDate 2017-01-01
publisher Elsevier
record_format Article
series NeuroImage: Clinical
spelling doaj.art-e4b84c87da414243b8bcabb810ea9a072022-12-22T00:47:18ZengElsevierNeuroImage: Clinical2213-15822017-01-01158094Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependenceSinem Balta Beylergil0Anne Beck1Lorenz Deserno2Robert C. Lorenz3Michael A. Rapp4Florian Schlagenhauf5Andreas Heinz6Klaus Obermayer7Department of Software Engineering and Theoretical Computer Science, Technische Universität Berlin, 10587 Berlin, Germany; Bernstein Center for Computational Neuroscience Berlin, 10115 Berlin, Germany; Corresponding author at: Neural Information Processing Group, Technische Universität Berlin, Marchstrasse 23, Sekr. MAR 5-6, 10587 Berlin, Germany.Department of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, 10117 Berlin, GermanyDepartment of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany; Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany; Department of Neurology, Otto von Guericke University, 39118 Magdeburg, GermanyDepartment of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany; Center for Adaptive Rationality, Max Planck Institute for Human Development, 14195 Berlin, GermanySocial and Preventive Medicine, University of Potsdam, 14469 Potsdam, GermanyDepartment of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany; Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, GermanyDepartment of Psychiatry and Psychotherapy, Charité-Universitätsmedizin Berlin, 10117 Berlin, Germany; Cluster of Excellence NeuroCure, Charité-Universitätsmedizin Berlin, 10117 Berlin, GermanyDepartment of Software Engineering and Theoretical Computer Science, Technische Universität Berlin, 10587 Berlin, Germany; Bernstein Center for Computational Neuroscience Berlin, 10115 Berlin, GermanySubstance-dependent individuals often lack the ability to adjust decisions flexibly in response to the changes in reward contingencies. Prediction errors (PEs) are thought to mediate flexible decision-making by updating the reward values associated with available actions. In this study, we explored whether the neurobiological correlates of PEs are altered in alcohol dependence. Behavioral, and functional magnetic resonance imaging (fMRI) data were simultaneously acquired from 34 abstinent alcohol-dependent patients (ADP) and 26 healthy controls (HC) during a probabilistic reward-guided decision-making task with dynamically changing reinforcement contingencies. A hierarchical Bayesian inference method was used to fit and compare learning models with different assumptions about the amount of task-related information subjects may have inferred during the experiment. Here, we observed that the best-fitting model was a modified Rescorla-Wagner type model, the “double-update” model, which assumes that subjects infer the knowledge that reward contingencies are anti-correlated, and integrate both actual and hypothetical outcomes into their decisions. Moreover, comparison of the best-fitting model's parameters showed that ADP were less sensitive to punishments compared to HC. Hence, decisions of ADP after punishments were loosely coupled with the expected reward values assigned to them. A correlation analysis between the model-generated PEs and the fMRI data revealed a reduced association between these PEs and the BOLD activity in the dorsolateral prefrontal cortex (DLPFC) of ADP. A hemispheric asymmetry was observed in the DLPFC when positive and negative PE signals were analyzed separately. The right DLPFC activity in ADP showed a reduced correlation with positive PEs. On the other hand, ADP, particularly the patients with high dependence severity, recruited the left DLPFC to a lesser extent than HC for processing negative PE signals. These results suggest that the DLPFC, which has been linked to adaptive control of action selection, may play an important role in cognitive inflexibility observed in alcohol dependence when reinforcement contingencies change. Particularly, the left DLPFC may contribute to this impaired behavioral adaptation, possibly by impeding the extinction of the actions that no longer lead to a reward. Keywords: Alcohol dependence, Prediction error, Reinforcement learning, Reversal learning, Dorsolateral prefrontal cortex, Decision-makinghttp://www.sciencedirect.com/science/article/pii/S2213158217300876
spellingShingle Sinem Balta Beylergil
Anne Beck
Lorenz Deserno
Robert C. Lorenz
Michael A. Rapp
Florian Schlagenhauf
Andreas Heinz
Klaus Obermayer
Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
NeuroImage: Clinical
title Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
title_full Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
title_fullStr Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
title_full_unstemmed Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
title_short Dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
title_sort dorsolateral prefrontal cortex contributes to the impaired behavioral adaptation in alcohol dependence
url http://www.sciencedirect.com/science/article/pii/S2213158217300876
work_keys_str_mv AT sinembaltabeylergil dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT annebeck dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT lorenzdeserno dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT robertclorenz dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT michaelarapp dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT florianschlagenhauf dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT andreasheinz dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence
AT klausobermayer dorsolateralprefrontalcortexcontributestotheimpairedbehavioraladaptationinalcoholdependence