A mixture of delta-rules approximation to bayesian inference in change-point problems.

Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies...

Full description

Bibliographic Details
Main Authors: Robert C Wilson, Matthew R Nassar, Joshua I Gold
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2013-01-01
Series:PLoS Computational Biology
Online Access:https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/23935472/pdf/?tool=EBI
_version_ 1818700980469891072
author Robert C Wilson
Matthew R Nassar
Joshua I Gold
author_facet Robert C Wilson
Matthew R Nassar
Joshua I Gold
author_sort Robert C Wilson
collection DOAJ
description Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies have defined optimal solutions to learning problems in more general, potentially unstable, environments, but the relevance of these complex mathematical solutions to how the brain solves these problems remains unclear. Here, we show that one such Bayesian solution can be approximated by a computationally straightforward mixture of simple error-driven 'Delta' rules. This simpler model can make effective inferences in a dynamic environment and matches human performance on a predictive-inference task using a mixture of a small number of Delta rules. This model represents an important conceptual advance in our understanding of how the brain can use relatively simple computations to make nearly optimal inferences in a dynamic world.
first_indexed 2024-12-17T15:13:34Z
format Article
id doaj.art-319536d444224beeac36e201a42ed281
institution Directory Open Access Journal
issn 1553-734X
1553-7358
language English
last_indexed 2024-12-17T15:13:34Z
publishDate 2013-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS Computational Biology
spelling doaj.art-319536d444224beeac36e201a42ed2812022-12-21T21:43:35ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582013-01-0197e100315010.1371/journal.pcbi.1003150A mixture of delta-rules approximation to bayesian inference in change-point problems.Robert C WilsonMatthew R NassarJoshua I GoldError-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies have defined optimal solutions to learning problems in more general, potentially unstable, environments, but the relevance of these complex mathematical solutions to how the brain solves these problems remains unclear. Here, we show that one such Bayesian solution can be approximated by a computationally straightforward mixture of simple error-driven 'Delta' rules. This simpler model can make effective inferences in a dynamic environment and matches human performance on a predictive-inference task using a mixture of a small number of Delta rules. This model represents an important conceptual advance in our understanding of how the brain can use relatively simple computations to make nearly optimal inferences in a dynamic world.https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/23935472/pdf/?tool=EBI
spellingShingle Robert C Wilson
Matthew R Nassar
Joshua I Gold
A mixture of delta-rules approximation to bayesian inference in change-point problems.
PLoS Computational Biology
title A mixture of delta-rules approximation to bayesian inference in change-point problems.
title_full A mixture of delta-rules approximation to bayesian inference in change-point problems.
title_fullStr A mixture of delta-rules approximation to bayesian inference in change-point problems.
title_full_unstemmed A mixture of delta-rules approximation to bayesian inference in change-point problems.
title_short A mixture of delta-rules approximation to bayesian inference in change-point problems.
title_sort mixture of delta rules approximation to bayesian inference in change point problems
url https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/23935472/pdf/?tool=EBI
work_keys_str_mv AT robertcwilson amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT matthewrnassar amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT joshuaigold amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT robertcwilson mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT matthewrnassar mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT joshuaigold mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems