Analysis of Deep Convolutional Neural Networks Using Tensor Kernels and Matrix-Based Entropy

Analysis of Deep Convolutional Neural Networks Using Tensor Kernels and Matrix-Based Entropy

Analyzing deep neural networks (DNNs) via information plane (IP) theory has gained tremendous attention recently to gain insight into, among others, DNNs’ generalization ability. However, it is by no means obvious how to estimate the mutual information (MI) between each hidden layer and the input/de...

Full description

Bibliographic Details
Main Authors: Kristoffer K. Wickstrøm, Sigurd Løkse, Michael C. Kampffmeyer, Shujian Yu, José C. Príncipe, Robert Jenssen
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Series:Entropy
Subjects:
information theory
deep learning
information plane
kernels methods
Online Access:https://www.mdpi.com/1099-4300/25/6/899

Internet

https://www.mdpi.com/1099-4300/25/6/899

Similar Items