Entropy and Divergence Associated with Power Function and the Statistical Application

In statistical physics, Boltzmann-Shannon entropy provides good understanding for the equilibrium states of a number of phenomena. In statistics, the entropy corresponds to the maximum likelihood method, in which Kullback-Leibler divergence connects Boltzmann-Shannon entropy and the expected log-lik...

Full description

Bibliographic Details
Main Authors: Shogo Kato, Shinto Eguchi
Format: Article
Language:English
Published: MDPI AG 2010-02-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/12/2/262/