A Measure of Information Available for Inference

The mutual information between the state of a neural network and the state of the external world represents the amount of information stored in the neural network that is associated with the external world. In contrast, the surprise of the sensory input indicates the unpredictability of the current...

Full description

Bibliographic Details
Main Author: Takuya Isomura
Format: Article
Language:English
Published: MDPI AG 2018-07-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/20/7/512