An Information Theoretic Interpretation to Deep Neural Networks

© 2019 IEEE. It is commonly believed that the hidden layers of deep neural networks (DNNs) attempt to extract informative features for learning tasks. In this paper, we formalize this intuition by showing that the features extracted by DNN coincide with the result of an optimization problem, which w...

Full description

Bibliographic Details
Main Authors: Huang, Shao-Lun, Xu, Xiangxiang, Zheng, Lizhong, Wornell, Gregory W
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:English
Published: Institute of Electrical and Electronics Engineers (IEEE) 2021
Online Access:https://hdl.handle.net/1721.1/137944