Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration
Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this...
| Egile Nagusiak: | , |
|---|---|
| Formatua: | Artikulua |
| Hizkuntza: | English |
| Argitaratua: |
Frontiers Media S.A.
2012-10-01
|
| Saila: | Frontiers in Neuroscience |
| Gaiak: | |
| Sarrera elektronikoa: | http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00150/full |
| _version_ | 1828229183746080768 |
|---|---|
| author | Elise ePayzan-LeNestour Elise ePayzan-LeNestour Peter eBossaerts |
| author_facet | Elise ePayzan-LeNestour Elise ePayzan-LeNestour Peter eBossaerts |
| author_sort | Elise ePayzan-LeNestour |
| collection | DOAJ |
| description | Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this theory, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our theory using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives. |
| first_indexed | 2024-04-12T18:30:33Z |
| format | Article |
| id | doaj.art-ca3c9a901b124d928cb39a4527e38954 |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-04-12T18:30:33Z |
| publishDate | 2012-10-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-ca3c9a901b124d928cb39a4527e389542022-12-22T03:21:05ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2012-10-01610.3389/fnins.2012.0015031851Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate explorationElise ePayzan-LeNestour0Elise ePayzan-LeNestour1Peter eBossaerts2University of New South WalesCalifornia Institute of TechnologyCalifornia Institute of TechnologyLittle is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this theory, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our theory using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00150/fullunexpected uncertaintyBayesian learningEstimation UncertaintyExploration BonusesRestless bandit problem |
| spellingShingle | Elise ePayzan-LeNestour Elise ePayzan-LeNestour Peter eBossaerts Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration Frontiers in Neuroscience unexpected uncertainty Bayesian learning Estimation Uncertainty Exploration Bonuses Restless bandit problem |
| title | Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration |
| title_full | Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration |
| title_fullStr | Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration |
| title_full_unstemmed | Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration |
| title_short | Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration |
| title_sort | don t bet on the unknown versus try to find out more estimation uncertainty and unexpected uncertainty both modulate exploration |
| topic | unexpected uncertainty Bayesian learning Estimation Uncertainty Exploration Bonuses Restless bandit problem |
| url | http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00150/full |
| work_keys_str_mv | AT eliseepayzanlenestour dontbetontheunknownversustrytofindoutmoreestimationuncertaintyandunexpecteduncertaintybothmodulateexploration AT eliseepayzanlenestour dontbetontheunknownversustrytofindoutmoreestimationuncertaintyandunexpecteduncertaintybothmodulateexploration AT peterebossaerts dontbetontheunknownversustrytofindoutmoreestimationuncertaintyandunexpecteduncertaintybothmodulateexploration |