Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration

Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this...

Volledige beschrijving

Bibliografische gegevens
Hoofdauteurs: Elise ePayzan-LeNestour, Peter eBossaerts
Formaat: Artikel
Taal:English
Gepubliceerd in: Frontiers Media S.A. 2012-10-01
Reeks:Frontiers in Neuroscience
Onderwerpen:
Online toegang:http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00150/full
Omschrijving
Samenvatting:Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this theory, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our theory using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
ISSN:1662-453X