On Normalized Mutual Information: Measure Derivations and Properties

On Normalized Mutual Information: Measure Derivations and Properties

Starting with a new formulation for the mutual information (MI) between a pair of events, this paper derives alternative upper bounds and extends those to the case of two discrete random variables. Normalized mutual information (NMI) measures are then obtained from those bounds, emphasizing the use...

Full description

Bibliographic Details
Main Author:	Tarald O. Kvålseth
Format:	Article
Language:	English
Published:	MDPI AG 2017-11-01
Series:	Entropy
Subjects:	mutual information normalized mutual information association measures similarity measures value validity
Online Access:	https://www.mdpi.com/1099-4300/19/11/631

Similar Items

An Axiomatic Characterization of Mutual Information
by: James Fullwood
Published: (2023-04-01)

Error Exponents and <i>α</i>-Mutual Information
by: Sergio Verdú
Published: (2021-02-01)

Cumulative Measure of Inaccuracy and Mutual Information in <i>k</i>-th Lower Record Values
by: Maryam Eskandarzadeh, et al.
Published: (2019-02-01)

An integrated review of measures of mutuality: Pros, cons, and future directions
by: Bridget Hamilton, et al.
Published: (2023-02-01)

Tsallis Mutual Information for Document Classification
by: Màrius Vila, et al.
Published: (2011-09-01)

Improved quality metrics for association and reproducibility in chromatin accessibility data using mutual information
by: Cullen Roth, et al.
Published: (2023-11-01)

Quadratic Mutual Information Feature Selection
by: Davor Sluga, et al.
Published: (2017-04-01)

Testing Nonlinearity with Rényi and Tsallis Mutual Information with an Application in the EKC Hypothesis
by: Elif Tuna, et al.
Published: (2022-12-01)

Conditional Rényi Divergence Saddlepoint and the Maximization of <i>α</i>-Mutual Information
by: Changxiao Cai, et al.
Published: (2019-10-01)

Mutual Information: A way to quantify correlations
by: Marcelo Tisoc, et al.
Published: (2022-08-01)

A Novel Just-in-Time Learning Strategy for Soft Sensing with Improved Similarity Measure Based on Mutual Information and PLS
by: Yueli Song, et al.
Published: (2020-07-01)

Estimation of signal information content for classification
by: Fisher, John W., III, et al.
Published: (2010)

Use of Average Mutual Information and Derived Measures to Find Coding Regions
by: Garin Newcomb, et al.
Published: (2021-10-01)

Mutual Information in Conjugate Spaces for Neutral Atoms and Ions
by: Juan Carlos Angulo, et al.
Published: (2022-02-01)

Assessing Conceptual Complexity and Compressibility Using Information Gain and Mutual Information
by: Fabien Mathy
Published: (2010-03-01)

Generalized Mutual Information
by: Zhiyi Zhang
Published: (2020-06-01)

Reviewing Evolution of Learning Functions and Semantic Information Measures for Understanding Deep Learning
by: Chenguang Lu
Published: (2023-05-01)

A Novel Variable Selection Method Based on Binning-Normalized Mutual Information for Multivariate Calibration
by: Liang Zhong, et al.
Published: (2023-07-01)

Generalised Measures of Multivariate Information Content
by: Conor Finn, et al.
Published: (2020-02-01)

Feature selection based on fuzzy joint mutual information maximization
by: Omar A. M. Salem, et al.
Published: (2021-04-01)

Localization of prostatic tumor’s infection based on normalized mutual information MRI image segmentation
by: Guoping Lu, et al.
Published: (2021-03-01)

IMAGE REGISTRATION BASED ON MAXIMIZATION OF GRADIENT CODE MUTUAL INFORMATION
by: Xiaoxiang Wang, et al.
Published: (2011-05-01)

Mutual Information between Order Book Layers
by: Daniel Libman, et al.
Published: (2022-02-01)

Non–Parametric Estimation of Mutual Information through the Entropy of the Linkage
by: Maria Teresa Giraudo, et al.
Published: (2013-11-01)

Information Bottleneck Analysis by a Conditional Mutual Information Bound
by: Taro Tezuka, et al.
Published: (2021-07-01)

Mutual information‐based binarisation of multiple images of an object: an application in medical imaging
by: Yaniv Gal, et al.
Published: (2013-06-01)

Synergy and Redundancy in Dual Decompositions of Mutual Information Gain and Information Loss
by: Daniel Chicharro, et al.
Published: (2017-02-01)

Hemodynamic Signal Research and Usage of Mutual Information Method
by: Tatyana Ermakova, et al.
Published: (2017-11-01)

Probability Mass Exclusions and the Directed Components of Mutual Information
by: Conor Finn, et al.
Published: (2018-10-01)

A Weighted Algorithm Based on Normalized Mutual Information for Estimating the Chlorophyll-a Concentration in Inland Waters Using Geostationary Ocean Color Imager (GOCI) Data
by: Ying Bao, et al.
Published: (2015-09-01)

An Information-Theoretic Approach to Detect the Associations of GPS-Tracked Heifers in Pasture
by: Cornelia Meckbach, et al.
Published: (2021-11-01)

A Measurement Model of Mutual Influence for Information Dissemination
by: Liang Zhang, et al.
Published: (2020-06-01)

Selection of Acupoints Combination Based on Pseudo Mutual Information Maximization
by: Jingjing Xu, et al.
Published: (2020-01-01)

Measuring Independence between Statistical Randomness Tests by Mutual Information
by: Jorge Augusto Karell-Albo, et al.
Published: (2020-07-01)

Exact Test of Independence Using Mutual Information
by: Shawn D. Pethel, et al.
Published: (2014-05-01)

Natural image segmentation based on mutual information
by: Zhu Yiwei
Published: (2020-01-01)

Estimating Quantum Mutual Information of Continuous-Variable Quantum States by Measuring Purity and Covariance Matrix
by: Jiyong Park
Published: (2022-07-01)

Empirical Estimation of Information Measures: A Literature Guide
by: Sergio Verdú
Published: (2019-07-01)

Complexity Reduction in Analyzing Independence between Statistical Randomness Tests Using Mutual Information
by: Jorge Augusto Karell-Albo, et al.
Published: (2023-11-01)

Kullback–Leibler Divergence and Mutual Information of Partitions in Product MV Algebras
by: Dagmar Markechová, et al.
Published: (2017-06-01)