Sparsity-Aware Orthogonal Initialization of Deep Neural Networks

Deep neural networks have achieved impressive pattern recognition and generative abilities on complex tasks by developing larger and deeper models, which are increasingly costly to train and implement. There is in tandem interest to develop sparse versions of these powerful models by post-processing...

Full description

Bibliographic Details
Main Authors: Kiara Esguerra, Muneeb Nasir, Tong Boon Tang, Afidalina Tumian, Eric Tatt Wei Ho
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10181312/