Balancing model-based and memory-free action selection under competitive pressure
In competitive situations, winning depends on selecting actions that surprise the opponent. Such unpredictable action can be generated based on representations of the opponent’s strategy and choice history (model-based counter-prediction) or by choosing actions in a memory-free, stochastic manner. A...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
eLife Sciences Publications Ltd
2019-10-01
|
| Series: | eLife |
| Subjects: | |
| Online Access: | https://elifesciences.org/articles/48810 |
| _version_ | 1828375846312738816 |
|---|---|
| author | Atsushi Kikumoto Ulrich Mayr |
| author_facet | Atsushi Kikumoto Ulrich Mayr |
| author_sort | Atsushi Kikumoto |
| collection | DOAJ |
| description | In competitive situations, winning depends on selecting actions that surprise the opponent. Such unpredictable action can be generated based on representations of the opponent’s strategy and choice history (model-based counter-prediction) or by choosing actions in a memory-free, stochastic manner. Across five different experiments using a variant of a matching-pennies game with simulated and human opponents we found that people toggle between these two strategies, using model-based selection when recent wins signal the appropriateness of the current model, but reverting to stochastic selection following losses. Also, after wins, feedback-related, mid-frontal EEG activity reflected information about the opponent’s global and local strategy, and predicted upcoming choices. After losses, this activity was nearly absent—indicating that the internal model is suppressed after negative feedback. We suggest that the mixed-strategy approach allows negotiating two conflicting goals: 1) exploiting the opponent’s deviations from randomness while 2) remaining unpredictable for the opponent. |
| first_indexed | 2024-04-14T07:52:32Z |
| format | Article |
| id | doaj.art-3a3a73fc80f5476281bf971a9199774e |
| institution | Directory Open Access Journal |
| issn | 2050-084X |
| language | English |
| last_indexed | 2024-04-14T07:52:32Z |
| publishDate | 2019-10-01 |
| publisher | eLife Sciences Publications Ltd |
| record_format | Article |
| series | eLife |
| spelling | doaj.art-3a3a73fc80f5476281bf971a9199774e2022-12-22T02:05:09ZengeLife Sciences Publications LtdeLife2050-084X2019-10-01810.7554/eLife.48810Balancing model-based and memory-free action selection under competitive pressureAtsushi Kikumoto0https://orcid.org/0000-0002-2179-2700Ulrich Mayr1https://orcid.org/0000-0002-7512-4556Department of Psychology, University of Oregon, Eugene, United StatesDepartment of Psychology, University of Oregon, Eugene, United StatesIn competitive situations, winning depends on selecting actions that surprise the opponent. Such unpredictable action can be generated based on representations of the opponent’s strategy and choice history (model-based counter-prediction) or by choosing actions in a memory-free, stochastic manner. Across five different experiments using a variant of a matching-pennies game with simulated and human opponents we found that people toggle between these two strategies, using model-based selection when recent wins signal the appropriateness of the current model, but reverting to stochastic selection following losses. Also, after wins, feedback-related, mid-frontal EEG activity reflected information about the opponent’s global and local strategy, and predicted upcoming choices. After losses, this activity was nearly absent—indicating that the internal model is suppressed after negative feedback. We suggest that the mixed-strategy approach allows negotiating two conflicting goals: 1) exploiting the opponent’s deviations from randomness while 2) remaining unpredictable for the opponent.https://elifesciences.org/articles/48810competitive behaviormodel-based choicestochastic choiceEEGfeedback-related processesanterior cingulate |
| spellingShingle | Atsushi Kikumoto Ulrich Mayr Balancing model-based and memory-free action selection under competitive pressure eLife competitive behavior model-based choice stochastic choice EEG feedback-related processes anterior cingulate |
| title | Balancing model-based and memory-free action selection under competitive pressure |
| title_full | Balancing model-based and memory-free action selection under competitive pressure |
| title_fullStr | Balancing model-based and memory-free action selection under competitive pressure |
| title_full_unstemmed | Balancing model-based and memory-free action selection under competitive pressure |
| title_short | Balancing model-based and memory-free action selection under competitive pressure |
| title_sort | balancing model based and memory free action selection under competitive pressure |
| topic | competitive behavior model-based choice stochastic choice EEG feedback-related processes anterior cingulate |
| url | https://elifesciences.org/articles/48810 |
| work_keys_str_mv | AT atsushikikumoto balancingmodelbasedandmemoryfreeactionselectionundercompetitivepressure AT ulrichmayr balancingmodelbasedandmemoryfreeactionselectionundercompetitivepressure |