A tutorial on stochastic approximation algorithms for training Restricted Boltzmann Machines and Deep Belief Nets

In this study, we provide a direct comparison of the Stochastic Maximum Likelihood algorithm and Contrastive Divergence for training Restricted Boltzmann Machines using the MNIST data set. We demonstrate that Stochastic Maximum Likelihood is superior when using the Restricted Boltzmann Machine as a...

全面介绍

书目详细资料
Main Authors: Swersky, K, Chen, B, Marlin, B, de Freitas, N
格式: Conference item
出版: 2010