Unsupervised discovery of nonlinear structure using contrastive backpropagation.
We describe a way of modeling high-dimensional data vectors by using an unsupervised, nonlinear, multilayer neural network in which the activity of each neuron-like unit makes an additive contribution to a global energy score that indicates how surprised the network is by the data vector. The connec...
Main Authors: | Hinton, G, Osindero, S, Welling, M, Teh, Y |
---|---|
Format: | Journal article |
Language: | English |
Published: |
2006
|
Similar Items
-
Energy-based models for sparse overcomplete representations
by: Teh, Y, et al.
Published: (2004) -
A fast learning algorithm for deep belief nets.
by: Hinton, G, et al.
Published: (2006) -
Unsupervised part discovery from contrastive reconstruction
by: Choudhury, S, et al.
Published: (2021) -
Backpropagation and the brain
by: Lillicrap, TP, et al.
Published: (2020) -
Unsupervised discovery of parts, structure, and dynamics
by: Xu, Zhenjia, et al.
Published: (2020)