A tutorial on stochastic approximation algorithms for training Restricted Boltzmann Machines and Deep Belief Nets

In this study, we provide a direct comparison of the Stochastic Maximum Likelihood algorithm and Contrastive Divergence for training Restricted Boltzmann Machines using the MNIST data set. We demonstrate that Stochastic Maximum Likelihood is superior when using the Restricted Boltzmann Machine as a...

Celý popis

Podrobná bibliografie
Hlavní autoři: Swersky, K, Chen, B, Marlin, B, de Freitas, N
Médium: Conference item
Vydáno: 2010