Information Theoretic Methods for Variable Selection—A Review

We review the principal information theoretic tools and their use for feature selection, with the main emphasis on classification problems with discrete features. Since it is known that empirical versions of conditional mutual information perform poorly for high-dimensional problems, we focus on var...

Full description

Bibliographic Details
Main Author: Jan Mielniczuk
Format: Article
Language:English
Published: MDPI AG 2022-08-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/24/8/1079