An Information Theoretic Interpretation to Deep Neural Networks

With the unprecedented performance achieved by deep learning, it is commonly believed that deep neural networks (DNNs) attempt to extract informative features for learning tasks. To formalize this intuition, we apply the local information geometric analysis and establish an information-theoretic fra...

Full description

Bibliographic Details
Main Authors: Xu, Xiangxiang, Huang, Shao-Lun, Zheng, Lizhong, Wornell, Gregory W.
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Published: Multidisciplinary Digital Publishing Institute 2022
Online Access:https://hdl.handle.net/1721.1/139647