Some Observations on the Concepts of Information-Theoretic Entropy and Randomness

Some Observations on the Concepts of Information-Theoretic Entropy and Randomness

Abstract: Certain aspects of the history, derivation, and physical application of the information-theoretic entropy concept are discussed. Pre-dating Shannon, the concept is traced back to Pauli. A derivation from first principles is given, without use of approximations. The concept depends on the u...

Full description

Bibliographic Details
Main Author: Jonathan D.H. Smith
Format: Article
Language:English
Published: MDPI AG 2001-02-01
Series:Entropy
Subjects:
information-theoretic entropy
Shannon entropy
Martin-Loef randomness
self-delimiting algorithmic complexity
thermodynamic entropy
second law of thermodynamics
selection principle
wave equation
Gibbs paradox
dimensional analysis
Kullback entropy
cross-entropy
reference density
improper prior
Online Access:http://www.mdpi.com/1099-4300/3/1/1/

Internet

http://www.mdpi.com/1099-4300/3/1/1/

Similar Items