New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees
The research concerns data collected in independent sets—more specifically, in local decision tables. A possible approach to managing these data is to build local classifiers based on each table individually. In the literature, many approaches toward combining the final prediction results of indepen...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-11-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/24/11/1604 |
| _version_ | 1797468388855906304 |
|---|---|
| author | Małgorzata Przybyła-Kasperek Katarzyna Kusztal |
| author_facet | Małgorzata Przybyła-Kasperek Katarzyna Kusztal |
| author_sort | Małgorzata Przybyła-Kasperek |
| collection | DOAJ |
| description | The research concerns data collected in independent sets—more specifically, in local decision tables. A possible approach to managing these data is to build local classifiers based on each table individually. In the literature, many approaches toward combining the final prediction results of independent classifiers can be found, but insufficient efforts have been made on the study of tables’ cooperation and coalitions’ formation. The importance of such an approach was expected on two levels. First, the impact on the quality of classification—the ability to build combined classifiers for coalitions of tables should allow for the learning of more generalized concepts. In turn, this should have an impact on the quality of classification of new objects. Second, combining tables into coalitions will result in reduced computational complexity—a reduced number of classifiers will be built. The paper proposes a new method for creating coalitions of local tables and generating an aggregated classifier for each coalition. Coalitions are generated by determining certain characteristics of attribute values occurring in local tables and applying the Pawlak conflict analysis model. In the study, the classification and regression trees with Gini index are built based on the aggregated table for one coalition. The system bears a hierarchical structure, as in the next stage the decisions generated by the classifiers for coalitions are aggregated using majority voting. The classification quality of the proposed system was compared with an approach that does not use local data cooperation and coalition creation. The structure of the system is parallel and decision trees are built independently for local tables. In the paper, it was shown that the proposed approach provides a significant improvement in classification quality and execution time. The Wilcoxon test confirmed that differences in accuracy rate of the results obtained for the proposed method and results obtained without coalitions are significant, with a <i>p</i> level = 0.005. The average accuracy rate values obtained for the proposed approach and the approach without coalitions are, respectively: 0.847 and 0.812; so the difference is quite large. Moreover, the algorithm implementing the proposed approach performed up to 21-times faster than the algorithm implementing the approach without using coalitions. |
| first_indexed | 2024-03-09T19:05:46Z |
| format | Article |
| id | doaj.art-b9df307efd614844960c5441cdf8dc87 |
| institution | Directory Open Access Journal |
| issn | 1099-4300 |
| language | English |
| last_indexed | 2024-03-09T19:05:46Z |
| publishDate | 2022-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj.art-b9df307efd614844960c5441cdf8dc872023-11-24T04:36:58ZengMDPI AGEntropy1099-43002022-11-012411160410.3390/e24111604New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision TreesMałgorzata Przybyła-Kasperek0Katarzyna Kusztal1Institute of Computer Science, University of Silesia in Katowice, Bȩdzińska 39, 41-200 Sosnowiec, PolandInstitute of Computer Science, University of Silesia in Katowice, Bȩdzińska 39, 41-200 Sosnowiec, PolandThe research concerns data collected in independent sets—more specifically, in local decision tables. A possible approach to managing these data is to build local classifiers based on each table individually. In the literature, many approaches toward combining the final prediction results of independent classifiers can be found, but insufficient efforts have been made on the study of tables’ cooperation and coalitions’ formation. The importance of such an approach was expected on two levels. First, the impact on the quality of classification—the ability to build combined classifiers for coalitions of tables should allow for the learning of more generalized concepts. In turn, this should have an impact on the quality of classification of new objects. Second, combining tables into coalitions will result in reduced computational complexity—a reduced number of classifiers will be built. The paper proposes a new method for creating coalitions of local tables and generating an aggregated classifier for each coalition. Coalitions are generated by determining certain characteristics of attribute values occurring in local tables and applying the Pawlak conflict analysis model. In the study, the classification and regression trees with Gini index are built based on the aggregated table for one coalition. The system bears a hierarchical structure, as in the next stage the decisions generated by the classifiers for coalitions are aggregated using majority voting. The classification quality of the proposed system was compared with an approach that does not use local data cooperation and coalition creation. The structure of the system is parallel and decision trees are built independently for local tables. In the paper, it was shown that the proposed approach provides a significant improvement in classification quality and execution time. The Wilcoxon test confirmed that differences in accuracy rate of the results obtained for the proposed method and results obtained without coalitions are significant, with a <i>p</i> level = 0.005. The average accuracy rate values obtained for the proposed approach and the approach without coalitions are, respectively: 0.847 and 0.812; so the difference is quite large. Moreover, the algorithm implementing the proposed approach performed up to 21-times faster than the algorithm implementing the approach without using coalitions.https://www.mdpi.com/1099-4300/24/11/1604Pawlak conflict analysis modelindependent data sourcescoalitionsdecision treesdispersed data |
| spellingShingle | Małgorzata Przybyła-Kasperek Katarzyna Kusztal New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees Entropy Pawlak conflict analysis model independent data sources coalitions decision trees dispersed data |
| title | New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees |
| title_full | New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees |
| title_fullStr | New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees |
| title_full_unstemmed | New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees |
| title_short | New Classification Method for Independent Data Sources Using Pawlak Conflict Model and Decision Trees |
| title_sort | new classification method for independent data sources using pawlak conflict model and decision trees |
| topic | Pawlak conflict analysis model independent data sources coalitions decision trees dispersed data |
| url | https://www.mdpi.com/1099-4300/24/11/1604 |
| work_keys_str_mv | AT małgorzataprzybyłakasperek newclassificationmethodforindependentdatasourcesusingpawlakconflictmodelanddecisiontrees AT katarzynakusztal newclassificationmethodforindependentdatasourcesusingpawlakconflictmodelanddecisiontrees |