Enhanced gradient learning for deep neural networks

Abstract Deep neural networks have achieved great success in both computer vision and natural language processing tasks. How to improve the gradient flows is crucial in training very deep neural networks. To address this challenge, a gradient enhancement approach is proposed through constructing the...

Full description

Bibliographic Details
Main Authors: Ming Yan, Jianxi Yang, Cen Chen, Joey Tianyi Zhou, Yi Pan, Zeng Zeng
Format: Article
Language:English
Published: Wiley 2022-02-01
Series:IET Image Processing
Online Access:https://doi.org/10.1049/ipr2.12353