A signal propagation perspective for pruning neural networks at initialization

Network pruning is a promising avenue for compressing deep neural networks. A typical approach to pruning starts by training a model and then removing redundant parameters while minimizing the impact on what is learned. Alternatively, a recent approach shows that pruning can be done at initializatio...

Full description

Bibliographic Details
Main Authors: Lee, N, Ajanthan, T, Gould, S, Torr, PHS
Format: Conference item
Language:English
Published: International Conference on Learning Representations 2019