An Optimization Approach of Deriving Bounds between Entropy and Error from Joint Distribution: Case Study for Binary Classifications

An Optimization Approach of Deriving Bounds between Entropy and Error from Joint Distribution: Case Study for Binary Classifications

In this work, we propose a new approach of deriving the bounds between entropy and error from a joint distribution through an optimization means. The specific case study is given on binary classifications. Two basic types of classification errors are investigated, namely, the Bayesian and non-Bayesi...

Descrizione completa

Dettagli Bibliografici
Autori principali:	Bao-Gang Hu, Hong-Jie Xing
Natura:	Articolo
Lingua:	English
Pubblicazione:	MDPI AG 2016-02-01
Serie:	Entropy
Soggetti:	entropy error probability Bayesian errors error types upper bound lower bound
Accesso online:	http://www.mdpi.com/1099-4300/18/2/59

Documenti analoghi

Theoretical Bounds on Performance in Threshold Group Testing Schemes
di: Jin-Taek Seong
Pubblicazione: (2020-04-01)

Analysis of the Upper Bound of Dynamic Error Obtained during Temperature Measurements
di: Krzysztof Tomczyk, et al.
Pubblicazione: (2022-10-01)

On the lower bound error for discrete maps using associative property
di: E.G. Nepomuceno, et al.
Pubblicazione: (2017-01-01)

Computable error bounds with improved applicability conditions for collocation methods
di: A. H. Ahmed
Pubblicazione: (1998-01-01)

On approximating the error function
di: Zhen-Hang Yang, et al.
Pubblicazione: (2016-11-01)

Accuracy Assessment of Charge-Mode Accelerometers Using Multivariate Regression of the Upper Bound of the Dynamic Error
di: Krzysztof Tomczyk, et al.
Pubblicazione: (2023-11-01)

Analysis of the Accelerometer Input–Output Energy Distribution Based on the Upper Bound of Absolute Dynamic Error
di: Krzysztof Tomczyk, et al.
Pubblicazione: (2020-11-01)

New global error bound for extended linear complementarity problems
di: Hongchun Sun, et al.
Pubblicazione: (2018-09-01)

An Error Bound for Low Order Approximation of Dynamical Systems Subjected to Initial Conditions
di: Gabriel Pedro Ramos Maciel, et al.
Pubblicazione: (2018-09-01)

Multistep methods for coupled second order integro-differential equations: stability, convergence and error bounds
di: Lucas Jódar, et al.
Pubblicazione: (1997-01-01)

Higher-order error bound for the difference of two functions
di: Hui Huang, et al.
Pubblicazione: (2018-10-01)

Seeking realistic upper-bounds for internal reliability of systems with uncorrelated observations
di: Prószyński Witold
Pubblicazione: (2014-06-01)

Radial Basis Functions Intended to Determine the Upper Bound of Absolute Dynamic Error at the Output of Voltage-Mode Accelerometers
di: Krzysztof Tomczyk, et al.
Pubblicazione: (2019-09-01)

New error bounds for asymptotic approximations of Jacobi polynomials and their zeros
di: L. GATTESCHI
Pubblicazione: (1994-01-01)

An improved error bound for linear complementarity problems for B-matrices
di: Lei Gao, et al.
Pubblicazione: (2017-06-01)

Information Theory in Formation Control: An Error Analysis to Multi-Robot Formation
di: Shuo Wan, et al.
Pubblicazione: (2018-08-01)

Bounds for blow-up time in a semilinear pseudo-parabolic equation with nonlocal source
di: Yang Lu, et al.
Pubblicazione: (2016-09-01)

Blockchain for bounded-error-pruned content protection
di: Ray-I. Chang, et al.
Pubblicazione: (2021-09-01)

The Gilbert-Varshamov Bound for Stabilizer Codes Over <inline-formula> <tex-math notation="LaTeX">$\mathbb{Z}_m$ </tex-math></inline-formula>
di: Nianqi Tang, et al.
Pubblicazione: (2018-01-01)

Recursive set membership estimation for output–error fractional models with unknown–but–bounded errors
di: Amairi Messaoud
Pubblicazione: (2016-09-01)

Lower-bound and upper-bound for rectangular and circular plates
di: Kovačević Saša
Pubblicazione: (2014-01-01)

Processing and Transmission of Information
di: Gallager, R. G., et al.
Pubblicazione: (2010)

Symmetry-Like Relation of Relative Entropy Measure of Quantum Coherence
di: Chengyang Zhang, et al.
Pubblicazione: (2020-03-01)

Impulsive control of nonlinear systems with impulse time window and bounded gain error
di: Limin Zou, et al.
Pubblicazione: (2018-02-01)

Quadratic error bound of the smoothed gap and the restarted averaged primal-dual hybrid gradient
di: Fercoq, Olivier
Pubblicazione: (2023-08-01)

On Robust Global Error Bounds for a Class of Uncertain Piecewise Linear Inequality Systems
di: Wen Tan, et al.
Pubblicazione: (2022-09-01)

Error estimation and adaptivity for PGD based on complementary solutions applied to a simple 1D problem
di: Jonatha Reis, et al.
Pubblicazione: (2020-10-01)

Computational Information Geometry for Binary Classification of High-Dimensional Random Tensors
di: Gia-Thuy Pham, et al.
Pubblicazione: (2018-03-01)

On Quantization Errors in Approximate and Sample Entropy
di: Dragana Bajić, et al.
Pubblicazione: (2021-12-01)

Error Bound of Mode-Based Additive Models
di: Hao Deng, et al.
Pubblicazione: (2021-05-01)

Improved Gilbert–Varshamov Bound for Entanglement-Assisted Asymmetric Quantum Error Correction by Symplectic Orthogonality
di: Ryutaroh Matsumoto
Pubblicazione: (2020-01-01)

Covering energy of posets and its bounds
di: Vandana P. Bhamre, et al.
Pubblicazione: (2023-12-01)

Frequency Limited & Weighted Model Reduction Algorithm With Error Bound: Application to Discrete-Time Doubly Fed Induction Generator Based Wind Turbines for Power System
di: Sajid Bashir, et al.
Pubblicazione: (2021-01-01)

Syntactic Parameters and a Coding Theory Perspective on Entropy and Complexity of Language Families
di: Matilde Marcolli
Pubblicazione: (2016-04-01)

A Nonclassical Stefan Problem with Nonlinear Thermal Parameters of General Order and Heat Source Term
di: Ammar Khanfer, et al.
Pubblicazione: (2023-12-01)

Global error bounds for the extended vertical LCP of ∑−SDD matrices
di: Mengting Gan
Pubblicazione: (2024-08-01)

Benefits and Impact of Joint Metric of AOA/RSS/TOF on Indoor Localization Error
di: Qing Jiang, et al.
Pubblicazione: (2016-10-01)

Blockwise and Low Density Key Error Correcting Codes
di: Pankaj Kumar Das, et al.
Pubblicazione: (2020-12-01)

A New Tight Upper Bound on the Entropy of Sums
di: Jihad Fahs, et al.
Pubblicazione: (2015-12-01)

Bounds for the Laplacian spectral radius of graphs
di: Kamal Lochan Patra, et al.
Pubblicazione: (2017-10-01)