Sensorimotor learning biases choice behavior: a learning neural field model for decision making.
According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action ch...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2012-01-01
|
| Series: | PLoS Computational Biology |
| Online Access: | http://europepmc.org/articles/PMC3499253?pdf=render |
| _version_ | 1818026319464628224 |
|---|---|
| author | Christian Klaes Sebastian Schneegans Gregor Schöner Alexander Gail |
| author_facet | Christian Klaes Sebastian Schneegans Gregor Schöner Alexander Gail |
| author_sort | Christian Klaes |
| collection | DOAJ |
| description | According to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making) should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action selection required for decision making in ambiguous choice situations. |
| first_indexed | 2024-12-10T04:30:07Z |
| format | Article |
| id | doaj.art-4876bceda7ec4409982c19cb4e447fba |
| institution | Directory Open Access Journal |
| issn | 1553-734X 1553-7358 |
| language | English |
| last_indexed | 2024-12-10T04:30:07Z |
| publishDate | 2012-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS Computational Biology |
| spelling | doaj.art-4876bceda7ec4409982c19cb4e447fba2022-12-22T02:02:10ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582012-01-01811e100277410.1371/journal.pcbi.1002774Sensorimotor learning biases choice behavior: a learning neural field model for decision making.Christian KlaesSebastian SchneegansGregor SchönerAlexander GailAccording to a prominent view of sensorimotor processing in primates, selection and specification of possible actions are not sequential operations. Rather, a decision for an action emerges from competition between different movement plans, which are specified and selected in parallel. For action choices which are based on ambiguous sensory input, the frontoparietal sensorimotor areas are considered part of the common underlying neural substrate for selection and specification of action. These areas have been shown capable of encoding alternative spatial motor goals in parallel during movement planning, and show signatures of competitive value-based selection among these goals. Since the same network is also involved in learning sensorimotor associations, competitive action selection (decision making) should not only be driven by the sensory evidence and expected reward in favor of either action, but also by the subject's learning history of different sensorimotor associations. Previous computational models of competitive neural decision making used predefined associations between sensory input and corresponding motor output. Such hard-wiring does not allow modeling of how decisions are influenced by sensorimotor learning or by changing reward contingencies. We present a dynamic neural field model which learns arbitrary sensorimotor associations with a reward-driven Hebbian learning algorithm. We show that the model accurately simulates the dynamics of action selection with different reward contingencies, as observed in monkey cortical recordings, and that it correctly predicted the pattern of choice errors in a control experiment. With our adaptive model we demonstrate how network plasticity, which is required for association learning and adaptation to new reward contingencies, can influence choice behavior. The field model provides an integrated and dynamic account for the operations of sensorimotor integration, working memory and action selection required for decision making in ambiguous choice situations.http://europepmc.org/articles/PMC3499253?pdf=render |
| spellingShingle | Christian Klaes Sebastian Schneegans Gregor Schöner Alexander Gail Sensorimotor learning biases choice behavior: a learning neural field model for decision making. PLoS Computational Biology |
| title | Sensorimotor learning biases choice behavior: a learning neural field model for decision making. |
| title_full | Sensorimotor learning biases choice behavior: a learning neural field model for decision making. |
| title_fullStr | Sensorimotor learning biases choice behavior: a learning neural field model for decision making. |
| title_full_unstemmed | Sensorimotor learning biases choice behavior: a learning neural field model for decision making. |
| title_short | Sensorimotor learning biases choice behavior: a learning neural field model for decision making. |
| title_sort | sensorimotor learning biases choice behavior a learning neural field model for decision making |
| url | http://europepmc.org/articles/PMC3499253?pdf=render |
| work_keys_str_mv | AT christianklaes sensorimotorlearningbiaseschoicebehavioralearningneuralfieldmodelfordecisionmaking AT sebastianschneegans sensorimotorlearningbiaseschoicebehavioralearningneuralfieldmodelfordecisionmaking AT gregorschoner sensorimotorlearningbiaseschoicebehavioralearningneuralfieldmodelfordecisionmaking AT alexandergail sensorimotorlearningbiaseschoicebehavioralearningneuralfieldmodelfordecisionmaking |