Mean field analysis of deep neural networks

We analyze multilayer neural networks in the asymptotic regime of simultaneously (a) large network sizes and (b) large numbers of stochastic gradient descent training iterations. We rigorously establish the limiting behavior of the multilayer neural network output. The limit procedure is valid for a...

Descrición completa

Detalles Bibliográficos
Main Authors: Sirignano, J, Spiliopoulos, K
Formato: Journal article
Idioma:English
Publicado: INFORMS 2021