Using mutual information to evaluate the generalization capability of deep learning neural networks
There is a need to better understand how generalization works in a deep learning model. The goal of this paper is to provide a clearer view of the black box called neural network. This is done by using information theory to compute the flow of information within a network. The proposed framework use...
Main Author: | Kan, Shawn Jung Tze |
---|---|
Other Authors: | Althea Liang |
Format: | Final Year Project (FYP) |
Language: | English |
Published: |
Nanyang Technological University
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/137910 |
Similar Items
-
Dissecting Deep Learning Networks—Visualizing Mutual Information
by: Hui Fang, et al.
Published: (2018-10-01) -
Utilizing Information Bottleneck to Evaluate the Capability of Deep Neural Networks for Image Classification
by: Hao Cheng, et al.
Published: (2019-05-01) -
Learning capabilities of neural networks
by: Huang, Guangbin.
Published: (2008) -
Evaluating and optimizing neural network models with neuromorphic capable and non-capable hardware
by: Cheong, Gordon Chin Loong
Published: (2021) -
Generalized Mutual Information
by: Zhiyi Zhang
Published: (2020-06-01)