Rapid Bayesian inference for expensive stochastic models

Almost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the simulation of models are growing even faster. This is large...

Full description

Bibliographic Details
Main Authors: Warne, DJ, Baker, RE, Simpson, MJ
Format: Journal article
Language:English
Published: Taylor and Francis 2021
_version_ 1797108133624020992
author Warne, DJ
Baker, RE
Simpson, MJ
author_facet Warne, DJ
Baker, RE
Simpson, MJ
author_sort Warne, DJ
collection OXFORD
description Almost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the simulation of models are growing even faster. This is largely due to the increase in model complexity, often including stochastic dynamics, that is necessary to describe and characterize phenomena observed using modern, high resolution, experimental techniques. Such models are rarely analytically tractable, meaning that extremely large numbers of stochastic simulations are required for parameter inference. In such cases, parameter inference can be practically impossible. In this work, we present new computational Bayesian techniques that accelerate inference for expensive stochastic models by using computationally inexpensive approximations to inform feasible regions in parameter space, and through learning transforms that adjust the biased approximate inferences to closer represent the correct inferences under the expensive stochastic model. Using topical examples from ecology and cell biology, we demonstrate a speed improvement of an order of magnitude without any loss in accuracy. This represents a substantial improvement over current state-of-the-art methods for Bayesian computations when appropriate model approximations are available.
first_indexed 2024-03-07T07:23:24Z
format Journal article
id oxford-uuid:c40cf795-4cdd-49f2-bb1a-9c14237002da
institution University of Oxford
language English
last_indexed 2024-03-07T07:23:24Z
publishDate 2021
publisher Taylor and Francis
record_format dspace
spelling oxford-uuid:c40cf795-4cdd-49f2-bb1a-9c14237002da2022-11-07T08:36:05ZRapid Bayesian inference for expensive stochastic modelsJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:c40cf795-4cdd-49f2-bb1a-9c14237002daEnglishSymplectic ElementsTaylor and Francis2021Warne, DJBaker, RESimpson, MJAlmost all fields of science rely upon statistical inference to estimate unknown parameters in theoretical and computational models. While the performance of modern computer hardware continues to grow, the computational requirements for the simulation of models are growing even faster. This is largely due to the increase in model complexity, often including stochastic dynamics, that is necessary to describe and characterize phenomena observed using modern, high resolution, experimental techniques. Such models are rarely analytically tractable, meaning that extremely large numbers of stochastic simulations are required for parameter inference. In such cases, parameter inference can be practically impossible. In this work, we present new computational Bayesian techniques that accelerate inference for expensive stochastic models by using computationally inexpensive approximations to inform feasible regions in parameter space, and through learning transforms that adjust the biased approximate inferences to closer represent the correct inferences under the expensive stochastic model. Using topical examples from ecology and cell biology, we demonstrate a speed improvement of an order of magnitude without any loss in accuracy. This represents a substantial improvement over current state-of-the-art methods for Bayesian computations when appropriate model approximations are available.
spellingShingle Warne, DJ
Baker, RE
Simpson, MJ
Rapid Bayesian inference for expensive stochastic models
title Rapid Bayesian inference for expensive stochastic models
title_full Rapid Bayesian inference for expensive stochastic models
title_fullStr Rapid Bayesian inference for expensive stochastic models
title_full_unstemmed Rapid Bayesian inference for expensive stochastic models
title_short Rapid Bayesian inference for expensive stochastic models
title_sort rapid bayesian inference for expensive stochastic models
work_keys_str_mv AT warnedj rapidbayesianinferenceforexpensivestochasticmodels
AT bakerre rapidbayesianinferenceforexpensivestochasticmodels
AT simpsonmj rapidbayesianinferenceforexpensivestochasticmodels