The Mathematical Structure of Information Bottleneck Methods

Information Bottleneck-based methods use mutual information as a distortion function in order to extract relevant details about the structure of a complex system by compression. One of the approaches used to generate optimal compressed representations is by annealing a parameter. In this manuscript...

Full description

Bibliographic Details
Main Authors: Albert E. Parker, Tomáš Gedeon, Alexander G. Dimitrov
Format: Article
Language:English
Published: MDPI AG 2012-03-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/14/3/456/