How does batch normalization help optimization?

© 2018 Curran Associates Inc.All rights reserved. Batch Normalization (BatchNorm) is a widely adopted technique that enables faster and more stable training of deep neural networks (DNNs). Despite its pervasiveness, the exact reasons for BatchNorm's effectiveness are still poorly understood. Th...

Full description

Bibliographic Details
Main Authors: Madry, Aleksander, Santurkar, Shibani, Tsipras, Dimitris, Ilyas, Andrew
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:English
Published: 2021
Online Access:https://hdl.handle.net/1721.1/137779