Sequential Monte Carlo for model selection and estimation of neural networks
We address the complex problem of sequential Bayesian learning and model selection for neural networks. This problem does not usually admit any type of closed-form analytical solution and, as a result, one has to resort to numerical methods. We propose here an original sequential simulation-based st...
| Main Authors: | , |
|---|---|
| Format: | Conference item |
| Published: |
2000
|
| _version_ | 1826271849672081408 |
|---|---|
| author | Andrieu, C de Freitas, N |
| author_facet | Andrieu, C de Freitas, N |
| author_sort | Andrieu, C |
| collection | OXFORD |
| description | We address the complex problem of sequential Bayesian learning and model selection for neural networks. This problem does not usually admit any type of closed-form analytical solution and, as a result, one has to resort to numerical methods. We propose here an original sequential simulation-based strategy to perform the necessary computations. It combines sequential importance sampling, a selection procedure, variance reduction techniques and reversible jump Markov chain Monte Carlo (MCMC) moves. We demonstrate the effectiveness of the method by applying it to radial basis function networks. The approach can be easily extended to other interesting on-line model selection problems |
| first_indexed | 2024-03-06T22:03:13Z |
| format | Conference item |
| id | oxford-uuid:4f513b4e-c700-4a03-bb62-5f5b709e9d29 |
| institution | University of Oxford |
| last_indexed | 2024-03-06T22:03:13Z |
| publishDate | 2000 |
| record_format | dspace |
| spelling | oxford-uuid:4f513b4e-c700-4a03-bb62-5f5b709e9d292022-03-26T16:06:21ZSequential Monte Carlo for model selection and estimation of neural networksConference itemhttp://purl.org/coar/resource_type/c_5794uuid:4f513b4e-c700-4a03-bb62-5f5b709e9d29Department of Computer Science2000Andrieu, Cde Freitas, NWe address the complex problem of sequential Bayesian learning and model selection for neural networks. This problem does not usually admit any type of closed-form analytical solution and, as a result, one has to resort to numerical methods. We propose here an original sequential simulation-based strategy to perform the necessary computations. It combines sequential importance sampling, a selection procedure, variance reduction techniques and reversible jump Markov chain Monte Carlo (MCMC) moves. We demonstrate the effectiveness of the method by applying it to radial basis function networks. The approach can be easily extended to other interesting on-line model selection problems |
| spellingShingle | Andrieu, C de Freitas, N Sequential Monte Carlo for model selection and estimation of neural networks |
| title | Sequential Monte Carlo for model selection and estimation of neural networks |
| title_full | Sequential Monte Carlo for model selection and estimation of neural networks |
| title_fullStr | Sequential Monte Carlo for model selection and estimation of neural networks |
| title_full_unstemmed | Sequential Monte Carlo for model selection and estimation of neural networks |
| title_short | Sequential Monte Carlo for model selection and estimation of neural networks |
| title_sort | sequential monte carlo for model selection and estimation of neural networks |
| work_keys_str_mv | AT andrieuc sequentialmontecarloformodelselectionandestimationofneuralnetworks AT defreitasn sequentialmontecarloformodelselectionandestimationofneuralnetworks |