Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration
Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this...
| Autori principali: | , |
|---|---|
| Natura: | Articolo |
| Lingua: | English |
| Pubblicazione: |
Frontiers Media S.A.
2012-10-01
|
| Serie: | Frontiers in Neuroscience |
| Soggetti: | |
| Accesso online: | http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00150/full |
| Riassunto: | Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this theory, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our theory using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives. |
|---|---|
| ISSN: | 1662-453X |