Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
Despite the widespread practical success of deep learning methods, our theoretical understanding of the dynamics of learning in deep neural networks remains quite sparse. We attempt to bridge the gap between the theory and practice of deep learning by systematically analyzing learning dynamics for t...
| Main Authors: | , , |
|---|---|
| Format: | Conference item |
| Published: |
International Conference on Learning Represenatations 2014
2014
|