Predicting Parameters in Deep Learning

We demonstrate that there is significant redundancy in the parameterization of several deep learning models. Given only a few weight values for each feature it is possible to accurately predict the remaining values. Moreover, we show that not only can the parameter values be predicted, but many of t...

Full description

Bibliographic Details
Main Authors: Denil, M, Shakibi, B, Dinh, L, Ranzato, M, de Freitas, N
Format: Conference item
Published: 2013