Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding.
Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. I...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2011-04-01
|
| Series: | PLoS Computational Biology |
| Online Access: | http://europepmc.org/articles/PMC3080848?pdf=render |
| _version_ | 1818492593713971200 |
|---|---|
| author | Quentin J M Huys Roshan Cools Martin Gölzer Eva Friedel Andreas Heinz Raymond J Dolan Peter Dayan |
| author_facet | Quentin J M Huys Roshan Cools Martin Gölzer Eva Friedel Andreas Heinz Raymond J Dolan Peter Dayan |
| author_sort | Quentin J M Huys |
| collection | DOAJ |
| description | Hard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility. |
| first_indexed | 2024-12-10T17:45:11Z |
| format | Article |
| id | doaj.art-f1194567dd194330989d4557d5d58ee6 |
| institution | Directory Open Access Journal |
| issn | 1553-734X 1553-7358 |
| language | English |
| last_indexed | 2024-12-10T17:45:11Z |
| publishDate | 2011-04-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS Computational Biology |
| spelling | doaj.art-f1194567dd194330989d4557d5d58ee62022-12-22T01:39:16ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582011-04-0174e100202810.1371/journal.pcbi.1002028Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding.Quentin J M HuysRoshan CoolsMartin GölzerEva FriedelAndreas HeinzRaymond J DolanPeter DayanHard-wired, Pavlovian, responses elicited by predictions of rewards and punishments exert significant benevolent and malevolent influences over instrumentally-appropriate actions. These influences come in two main groups, defined along anatomical, pharmacological, behavioural and functional lines. Investigations of the influences have so far concentrated on the groups as a whole; here we take the critical step of looking inside each group, using a detailed reinforcement learning model to distinguish effects to do with value, specific actions, and general activation or inhibition. We show a high degree of sophistication in Pavlovian influences, with appetitive Pavlovian stimuli specifically promoting approach and inhibiting withdrawal, and aversive Pavlovian stimuli promoting withdrawal and inhibiting approach. These influences account for differences in the instrumental performance of approach and withdrawal behaviours. Finally, although losses are as informative as gains, we find that subjects neglect losses in their instrumental learning. Our findings argue for a view of the Pavlovian system as a constraint or prior, facilitating learning by alleviating computational costs that come with increased flexibility.http://europepmc.org/articles/PMC3080848?pdf=render |
| spellingShingle | Quentin J M Huys Roshan Cools Martin Gölzer Eva Friedel Andreas Heinz Raymond J Dolan Peter Dayan Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Computational Biology |
| title | Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. |
| title_full | Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. |
| title_fullStr | Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. |
| title_full_unstemmed | Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. |
| title_short | Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. |
| title_sort | disentangling the roles of approach activation and valence in instrumental and pavlovian responding |
| url | http://europepmc.org/articles/PMC3080848?pdf=render |
| work_keys_str_mv | AT quentinjmhuys disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT roshancools disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT martingolzer disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT evafriedel disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT andreasheinz disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT raymondjdolan disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding AT peterdayan disentanglingtherolesofapproachactivationandvalenceininstrumentalandpavlovianresponding |