Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot

The effects of striatal dopamine (DA) on behavior have been widely investigated over the past decades, with ``phasic'' burst firings considered as the key expression of a reward prediction error responsible for reinforcement learning. Less well studied is tonic DA, where putative function...

Full description

Bibliographic Details
Main Authors: Vincenzo G. Fiore, Valerio eSperati, Francesco eMannella, Marco eMirolli, Kevin eGurney, Karl eFriston, Raymond J. Dolan, Gianluca eBaldassarre
Format: Article
Language:English
Published: Frontiers Media S.A. 2014-02-01
Series:Frontiers in Psychology
Subjects:
Online Access:http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00124/full
_version_ 1819296602497482752
author Vincenzo G. Fiore
Valerio eSperati
Francesco eMannella
Marco eMirolli
Kevin eGurney
Karl eFriston
Raymond J. Dolan
Gianluca eBaldassarre
author_facet Vincenzo G. Fiore
Valerio eSperati
Francesco eMannella
Marco eMirolli
Kevin eGurney
Karl eFriston
Raymond J. Dolan
Gianluca eBaldassarre
author_sort Vincenzo G. Fiore
collection DOAJ
description The effects of striatal dopamine (DA) on behavior have been widely investigated over the past decades, with ``phasic'' burst firings considered as the key expression of a reward prediction error responsible for reinforcement learning. Less well studied is tonic DA, where putative functions include the idea that it is a regulator of vigor, incentive salience, disposition to exert an effort and a modulator of approach strategies. We present a preliminary model combining tonic and phasic DA to show how different outflows triggered by either intrinsically or extrinsically motivating stimuli dynamically affect the basal ganglia by impacting on a selection process that this system performs on the inputs provided by the targeted cortex.<br/>The model, which has been tested on the simulated humanoid robot iCub in the interaction with a mechatronic board, shows the putative functions ascribed to DA emerging from the combination of a standard computational mechanism coupled to a differential sensitivity to the presence of DA across the striatum.
first_indexed 2024-12-24T05:00:43Z
format Article
id doaj.art-1bda99684e2c488fb9be959901f7344c
institution Directory Open Access Journal
issn 1664-1078
language English
last_indexed 2024-12-24T05:00:43Z
publishDate 2014-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Psychology
spelling doaj.art-1bda99684e2c488fb9be959901f7344c2022-12-21T17:14:10ZengFrontiers Media S.A.Frontiers in Psychology1664-10782014-02-01510.3389/fpsyg.2014.0012459656Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robotVincenzo G. Fiore0Valerio eSperati1Francesco eMannella2Marco eMirolli3Kevin eGurney4Karl eFriston5Raymond J. Dolan6Gianluca eBaldassarre7Wellcome Trust Centre for Neuroimaging, UCL Institute of NeurologyConsiglio Nazionale delle RicercheConsiglio Nazionale delle RicercheConsiglio Nazionale delle RicercheUniversity of SheffieldWellcome Trust Centre for Neuroimaging, UCL Institute of NeurologyWellcome Trust Centre for Neuroimaging, UCL Institute of NeurologyConsiglio Nazionale delle RicercheThe effects of striatal dopamine (DA) on behavior have been widely investigated over the past decades, with ``phasic'' burst firings considered as the key expression of a reward prediction error responsible for reinforcement learning. Less well studied is tonic DA, where putative functions include the idea that it is a regulator of vigor, incentive salience, disposition to exert an effort and a modulator of approach strategies. We present a preliminary model combining tonic and phasic DA to show how different outflows triggered by either intrinsically or extrinsically motivating stimuli dynamically affect the basal ganglia by impacting on a selection process that this system performs on the inputs provided by the targeted cortex.<br/>The model, which has been tested on the simulated humanoid robot iCub in the interaction with a mechatronic board, shows the putative functions ascribed to DA emerging from the combination of a standard computational mechanism coupled to a differential sensitivity to the presence of DA across the striatum.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00124/fullBasal GangliaDopaminecomputational modeliCubselectionaction selection
spellingShingle Vincenzo G. Fiore
Valerio eSperati
Francesco eMannella
Marco eMirolli
Kevin eGurney
Karl eFriston
Raymond J. Dolan
Gianluca eBaldassarre
Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
Frontiers in Psychology
Basal Ganglia
Dopamine
computational model
iCub
selection
action selection
title Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
title_full Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
title_fullStr Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
title_full_unstemmed Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
title_short Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
title_sort keep focussing striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot
topic Basal Ganglia
Dopamine
computational model
iCub
selection
action selection
url http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00124/full
work_keys_str_mv AT vincenzogfiore keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT valerioesperati keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT francescoemannella keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT marcoemirolli keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT kevinegurney keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT karlefriston keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT raymondjdolan keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot
AT gianlucaebaldassarre keepfocussingstriataldopaminemultiplefunctionsresolvedinasinglemechanismtestedinasimulatedhumanoidrobot