Don't bet on the unknown versus try to find out more: estimation uncertainty and ''unexpected uncertainty'' both modulate exploration

Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this...

詳細記述

書誌詳細
主要な著者: Elise ePayzan-LeNestour, Peter eBossaerts
フォーマット: 論文
言語:English
出版事項: Frontiers Media S.A. 2012-10-01
シリーズ:Frontiers in Neuroscience
主題:
オンライン・アクセス:http://journal.frontiersin.org/Journal/10.3389/fnins.2012.00150/full
その他の書誌記述
要約:Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel theory of exploration that helps reconcile prior findings that may seem contradictory at first. According to this theory, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our theory using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
ISSN:1662-453X