A tutorial on stochastic approximation algorithms for training Restricted Boltzmann Machines and Deep Belief Nets

In this study, we provide a direct comparison of the Stochastic Maximum Likelihood algorithm and Contrastive Divergence for training Restricted Boltzmann Machines using the MNIST data set. We demonstrate that Stochastic Maximum Likelihood is superior when using the Restricted Boltzmann Machine as a...

תיאור מלא

מידע ביבליוגרפי
Main Authors: Swersky, K, Chen, B, Marlin, B, de Freitas, N
פורמט: Conference item
יצא לאור: 2010