Sequential Monte Carlo Methods to Train Neural Network Models

We discuss a novel strategy for training neural networks using sequential Monte Carlo algorithms and propose a new hybrid gradient descent / sampling importance resampling algorithm (HySIR). In terms of computational time and accuracy, the hybrid SIR is a clear improvement over conventional sequenti...

Full description

Bibliographic Details
Main Authors: Freitas, D, Nando, Niranjan, M, Gee, A, Doucet, A
Format: Journal article
Published: 2000