Asymptotic analysis of deep residual networks
We investigate the asymptotic properties of deep Residual networks (ResNets) as the number of layers increases. We first show the existence of scaling regimes for trained weights markedly different from those implicitly assumed in the neural ODE literature. We study the convergence of the hidden sta...
| Main Authors: | , , |
|---|---|
| Format: | Internet publication |
| Language: | English |
| Published: |
2022
|