Information Theoretic Methods for Variable Selection—A Review
We review the principal information theoretic tools and their use for feature selection, with the main emphasis on classification problems with discrete features. Since it is known that empirical versions of conditional mutual information perform poorly for high-dimensional problems, we focus on var...
Main Author: | Jan Mielniczuk |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-08-01
|
Series: | Entropy |
Subjects: | |
Online Access: | https://www.mdpi.com/1099-4300/24/8/1079 |
Similar Items
-
Online Streaming Feature Selection via Conditional Independence
by: Dianlong You, et al.
Published: (2018-12-01) -
Online Streaming Features Selection via Markov Blanket
by: Waqar Khan, et al.
Published: (2022-01-01) -
A Feature Subset Selection Method Based On High-Dimensional Mutual Information
by: Chee Keong Kwoh, et al.
Published: (2011-04-01) -
Unsupervised Representative Feature Selection Algorithm Based on Information Entropy and Relevance Analysis
by: Yintong Wang
Published: (2018-01-01) -
Joint Markov Blankets in Feature Sets Extracted from Wavelet Packet Decompositions
by: Gert Van Dijck, et al.
Published: (2011-07-01)