A tutorial on stochastic approximation algorithms for training Restricted Boltzmann Machines and Deep Belief Nets

In this study, we provide a direct comparison of the Stochastic Maximum Likelihood algorithm and Contrastive Divergence for training Restricted Boltzmann Machines using the MNIST data set. We demonstrate that Stochastic Maximum Likelihood is superior when using the Restricted Boltzmann Machine as a...

Mô tả đầy đủ

Chi tiết về thư mục
Những tác giả chính: Swersky, K, Chen, B, Marlin, B, de Freitas, N
Định dạng: Conference item
Được phát hành: 2010