Mean field analysis of deep neural networks

We analyze multilayer neural networks in the asymptotic regime of simultaneously (a) large network sizes and (b) large numbers of stochastic gradient descent training iterations. We rigorously establish the limiting behavior of the multilayer neural network output. The limit procedure is valid for a...

Full description

Bibliographic Details
Main Authors: Sirignano, J, Spiliopoulos, K
Format: Journal article
Language:English
Published: INFORMS 2021