The Influence of Criteria Selection Method on Consistency of Pairwise Comparison
The more criteria a human decision involves, the more inconsistent the decision. This study experimentally examines the effect on the degree of pairwise comparison inconsistency by using the (im)possibility of selecting the criteria for the evaluation and the size of the decision-making problem. A t...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-12-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/8/12/2200 |
| _version_ | 1797545082034847744 |
|---|---|
| author | Vladimír Bureš Jiří Cabal Pavel Čech Karel Mls Daniela Ponce |
| author_facet | Vladimír Bureš Jiří Cabal Pavel Čech Karel Mls Daniela Ponce |
| author_sort | Vladimír Bureš |
| collection | DOAJ |
| description | The more criteria a human decision involves, the more inconsistent the decision. This study experimentally examines the effect on the degree of pairwise comparison inconsistency by using the (im)possibility of selecting the criteria for the evaluation and the size of the decision-making problem. A total of 358 participants completed objective and subjective tasks. While the former was associated with one possible correct solution, there was no single correct solution for the latter. The design of the experiment enabled the acquisition of eight groups in which the degree of inconsistency was quantified using three inconsistency indices (the Consistency Index, the Consistency Ratio and the Euclidean distance) and these were analysed by the repeated measures ANOVA. The results show a significant dependence of the degree of inconsistency on the method of determining the criteria for pairwise evaluation. If participants are randomly given the criteria, then with more criteria, the overall inconsistency of the comparison decreases. If the participants can themselves choose the criteria for the comparison, then with more criteria, the overall inconsistency of the comparison increases. This statistical dependence exists only for males. For females, the dependence is the opposite, but it is not statistically significant. |
| first_indexed | 2024-03-10T14:10:27Z |
| format | Article |
| id | doaj.art-1b68b6f3b79d4689965e5541abe8406d |
| institution | Directory Open Access Journal |
| issn | 2227-7390 |
| language | English |
| last_indexed | 2024-03-10T14:10:27Z |
| publishDate | 2020-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj.art-1b68b6f3b79d4689965e5541abe8406d2023-11-21T00:13:49ZengMDPI AGMathematics2227-73902020-12-01812220010.3390/math8122200The Influence of Criteria Selection Method on Consistency of Pairwise ComparisonVladimír Bureš0Jiří Cabal1Pavel Čech2Karel Mls3Daniela Ponce4Faculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 50003 Hradec Kralove, Czech RepublicFaculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 50003 Hradec Kralove, Czech RepublicFaculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 50003 Hradec Kralove, Czech RepublicFaculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 50003 Hradec Kralove, Czech RepublicFaculty of Informatics and Management, University of Hradec Kralove, Rokitanskeho 62, 50003 Hradec Kralove, Czech RepublicThe more criteria a human decision involves, the more inconsistent the decision. This study experimentally examines the effect on the degree of pairwise comparison inconsistency by using the (im)possibility of selecting the criteria for the evaluation and the size of the decision-making problem. A total of 358 participants completed objective and subjective tasks. While the former was associated with one possible correct solution, there was no single correct solution for the latter. The design of the experiment enabled the acquisition of eight groups in which the degree of inconsistency was quantified using three inconsistency indices (the Consistency Index, the Consistency Ratio and the Euclidean distance) and these were analysed by the repeated measures ANOVA. The results show a significant dependence of the degree of inconsistency on the method of determining the criteria for pairwise evaluation. If participants are randomly given the criteria, then with more criteria, the overall inconsistency of the comparison decreases. If the participants can themselves choose the criteria for the comparison, then with more criteria, the overall inconsistency of the comparison increases. This statistical dependence exists only for males. For females, the dependence is the opposite, but it is not statistically significant.https://www.mdpi.com/2227-7390/8/12/2200pairwise comparisoninconsistency measuresreal data experimentcomparison criteria selection methodmulti-criteria decision making |
| spellingShingle | Vladimír Bureš Jiří Cabal Pavel Čech Karel Mls Daniela Ponce The Influence of Criteria Selection Method on Consistency of Pairwise Comparison Mathematics pairwise comparison inconsistency measures real data experiment comparison criteria selection method multi-criteria decision making |
| title | The Influence of Criteria Selection Method on Consistency of Pairwise Comparison |
| title_full | The Influence of Criteria Selection Method on Consistency of Pairwise Comparison |
| title_fullStr | The Influence of Criteria Selection Method on Consistency of Pairwise Comparison |
| title_full_unstemmed | The Influence of Criteria Selection Method on Consistency of Pairwise Comparison |
| title_short | The Influence of Criteria Selection Method on Consistency of Pairwise Comparison |
| title_sort | influence of criteria selection method on consistency of pairwise comparison |
| topic | pairwise comparison inconsistency measures real data experiment comparison criteria selection method multi-criteria decision making |
| url | https://www.mdpi.com/2227-7390/8/12/2200 |
| work_keys_str_mv | AT vladimirbures theinfluenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT jiricabal theinfluenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT pavelcech theinfluenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT karelmls theinfluenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT danielaponce theinfluenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT vladimirbures influenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT jiricabal influenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT pavelcech influenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT karelmls influenceofcriteriaselectionmethodonconsistencyofpairwisecomparison AT danielaponce influenceofcriteriaselectionmethodonconsistencyofpairwisecomparison |