An Information Theoretic Interpretation to Deep Neural Networks
With the unprecedented performance achieved by deep learning, it is commonly believed that deep neural networks (DNNs) attempt to extract informative features for learning tasks. To formalize this intuition, we apply the local information geometric analysis and establish an information-theoretic fra...
Main Authors: | Xu, Xiangxiang, Huang, Shao-Lun, Zheng, Lizhong, Wornell, Gregory W. |
---|---|
Other Authors: | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
Format: | Article |
Published: |
Multidisciplinary Digital Publishing Institute
2022
|
Online Access: | https://hdl.handle.net/1721.1/139647 |
Similar Items
-
An Information Theoretic Interpretation to Deep Neural Networks
by: Huang, Shao-Lun, et al.
Published: (2021) -
An Information-theoretic Approach to Unsupervised Feature Selection for High-Dimensional Data
by: Huang, Shao-Lun, et al.
Published: (2021) -
A Local Characterization for Wyner Common Information
by: Huang, Shao-Lun, et al.
Published: (2021) -
An information-theoretic approach to unsupervised feature selection for high-dimensional data
by: Huang, Shao-Lun, et al.
Published: (2021) -
Euclidean Information Theory of Networks
by: Huang, Shao-Lun, et al.
Published: (2022)