Hybrid modeling of structure extension and instance weighting for naive Bayes

Due to robustness and efficiency, naive Bayes (NB) remains among the top ten data mining algorithms. However, the required conditional independence assumption more or less limits its classification performance. Of numerous approaches to improving NB, structure extension and instance weighting have b...

Повний опис

Бібліографічні деталі
Автори: Yu Liangjun, Wang Di, Zhou Xian, Wu Xiaomin
Формат: Стаття
Мова:English
Опубліковано: De Gruyter 2025-02-01
Серія:Journal of Intelligent Systems
Предмети:
Онлайн доступ:https://doi.org/10.1515/jisys-2024-0400
Опис
Резюме:Due to robustness and efficiency, naive Bayes (NB) remains among the top ten data mining algorithms. However, the required conditional independence assumption more or less limits its classification performance. Of numerous approaches to improving NB, structure extension and instance weighting have both achieved remarkable improvements. To make full use of their complementary and consensus advantages, this article proposes a hybrid modeling approach to combining structure extension with instance weighting. We call the resulting model instance weighted averaged one-dependence estimators (IWAODE). In IWAODE, the dependencies among attributes are modeled by an ensemble of one-dependence estimators, and the corresponding probabilities are estimated from attribute value frequency-weighted training instances. The classification performance of IWAODE is experimentally validated on a large number of datasets.
ISSN:2191-026X