Two-sided exponential concentration bounds for Bayes error rate and Shannon entropy

We provide a method that approximates the Bayes error rate and the Shannon entropy with high probability. The Bayes error rate approximation makes possible to build a classifier that polynomially approaches Bayes error rate. The Shannon entropy approximation provides provable performance guarantees...

Full description

Bibliographic Details
Main Authors: Honorio, Jean, Jaakkola, Tommi S.
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:en_US
Published: Association for Computing Machinery (ACM) 2015
Online Access:http://hdl.handle.net/1721.1/100427
https://orcid.org/0000-0003-0238-6384
https://orcid.org/0000-0002-2199-0379