Rényi Cross-Entropy Measures for Common Distributions and Processes with Memory

Two Rényi-type generalizations of the Shannon cross-entropy, the Rényi cross-entropy and the Natural Rényi cross-entropy, were recently used as loss functions for the improved design of deep learning generative adversarial networks. In this work, we derive the Rényi and Natural Rényi differential cr...

Full description

Bibliographic Details
Main Authors: Ferenc Cole Thierrin, Fady Alajaji, Tamás Linder
Format: Article
Language:English
Published: MDPI AG 2022-10-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/24/10/1417