Learnability for the Information Bottleneck

The Information Bottleneck (IB) method provides an insightful and principled approach for balancing compression and prediction for representation learning. The IB objective I ( X ; Z ) - β I ( Y ; Z ) employs a Lagrange multiplier β to tune this trade-off. However, in practice, not onl...

Full description

Bibliographic Details
Main Authors: Wu, Tailin, Fischer, Ian, Chuang, Isaac L., Tegmark, Max Erik
Other Authors: Massachusetts Institute of Technology. Department of Physics
Format: Article
Language:English
Published: MDPI AG 2020
Online Access:https://hdl.handle.net/1721.1/126053