Increasing and Decreasing Returns and Losses in Mutual Information Feature Subset Selection

Increasing and Decreasing Returns and Losses in Mutual Information Feature Subset Selection

Mutual information between a target variable and a feature subset is extensively used as a feature subset selection criterion. This work contributes to a more thorough understanding of the evolution of the mutual information as a function of the number of features selected. We describe decreasing re...

Full description

Bibliographic Details
Main Authors: Marc M. Van Hulle, Gert Van Dijck
Format: Article
Language:English
Published: MDPI AG 2010-10-01
Series:Entropy
Subjects:
Bayesian networks
bit parity
conditional entropy
conditional mutual information
decreasing losses
decreasing returns
feature subset selection
increasing losses
increasing returns
Online Access:http://www.mdpi.com/1099-4300/12/10/2144/

Internet

http://www.mdpi.com/1099-4300/12/10/2144/

Similar Items