Maximum Entropy: Clearing up Mysteries

Abstract: There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes' die problem, the cause célèbre of MaxEnt. After discussing the mystifications a new formulation of th...

Full description

Bibliographic Details
Main Author: Marian Grendár
Format: Article
Language:English
Published: MDPI AG 2001-04-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/3/2/58/
_version_ 1817992814179385344
author Marian Grendár
Marian Grendár
author_facet Marian Grendár
Marian Grendár
author_sort Marian Grendár
collection DOAJ
description Abstract: There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes' die problem, the cause célèbre of MaxEnt. After discussing the mystifications a new formulation of the problem is proposed. Then we turn to the mysteries. An answer to the recurring question 'Just what are we accomplishing when we maximize entropy?' [8], based on MaxProb rationale of MaxEnt [6], is recalled. A brief view on the other mystery: 'What is the relation between MaxEnt and the Bayesian method?' [9], in light of the MaxProb rationale of MaxEnt suggests that there is not and cannot be a conflict between MaxEnt and Bayes Theorem.
first_indexed 2024-04-14T01:32:11Z
format Article
id doaj.art-af5189ef54744baf8ca71c5aa48a7029
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-04-14T01:32:11Z
publishDate 2001-04-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-af5189ef54744baf8ca71c5aa48a70292022-12-22T02:20:09ZengMDPI AGEntropy1099-43002001-04-0132586310.3390/e3020058Maximum Entropy: Clearing up MysteriesMarian GrendárMarian GrendárAbstract: There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes' die problem, the cause célèbre of MaxEnt. After discussing the mystifications a new formulation of the problem is proposed. Then we turn to the mysteries. An answer to the recurring question 'Just what are we accomplishing when we maximize entropy?' [8], based on MaxProb rationale of MaxEnt [6], is recalled. A brief view on the other mystery: 'What is the relation between MaxEnt and the Bayesian method?' [9], in light of the MaxProb rationale of MaxEnt suggests that there is not and cannot be a conflict between MaxEnt and Bayes Theorem.http://www.mdpi.com/1099-4300/3/2/58/maximum entropymaximum probabilityJaynes' die problemmaximum likelihoodminimax entropy
spellingShingle Marian Grendár
Marian Grendár
Maximum Entropy: Clearing up Mysteries
Entropy
maximum entropy
maximum probability
Jaynes' die problem
maximum likelihood
minimax entropy
title Maximum Entropy: Clearing up Mysteries
title_full Maximum Entropy: Clearing up Mysteries
title_fullStr Maximum Entropy: Clearing up Mysteries
title_full_unstemmed Maximum Entropy: Clearing up Mysteries
title_short Maximum Entropy: Clearing up Mysteries
title_sort maximum entropy clearing up mysteries
topic maximum entropy
maximum probability
Jaynes' die problem
maximum likelihood
minimax entropy
url http://www.mdpi.com/1099-4300/3/2/58/
work_keys_str_mv AT mariangrendaƒar maximumentropyclearingupmysteries
AT mariangrendaƒar maximumentropyclearingupmysteries