A Forward-Looking Approach to Compare Ranking Methods for Sports
In this paper, we provide a simple forward-looking approach to compare rating methods with respect to their stability over time. Given a rating vector of entities involved in the comparison and a ranking indicated by the rating, the stability of the methods is measured by the change in rating vector...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-05-01
|
Series: | Information |
Subjects: | |
Online Access: | https://www.mdpi.com/2078-2489/13/5/232 |
_version_ | 1797499060903477248 |
---|---|
author | Peter Juma Ochieng András London Miklós Krész |
author_facet | Peter Juma Ochieng András London Miklós Krész |
author_sort | Peter Juma Ochieng |
collection | DOAJ |
description | In this paper, we provide a simple forward-looking approach to compare rating methods with respect to their stability over time. Given a rating vector of entities involved in the comparison and a ranking indicated by the rating, the stability of the methods is measured by the change in rating vector and ranks of the entities over time from a forward-looking perspective. We investigate various linear algebraic rating methods and use the Euclidean distance and Kendall tau rank correlation to measure their stability in rating and ranking, respectively. The investigations are based on both rolling and expanding window approaches. We apply the methodology to sports as a widely known ranking and rating environment. The results suggest that PageRank and Massey rating methods provide better rating and ranking stability than simple methods, such as winning percentage, and more advanced ones, such as Colley’s least square and Keener’s eigenvector-based method. Finally, a simple way to examine the potential predictive power of the rating methods is also provided. |
first_indexed | 2024-03-10T03:42:03Z |
format | Article |
id | doaj.art-f4c0dc3499b644f4a553e9485120808b |
institution | Directory Open Access Journal |
issn | 2078-2489 |
language | English |
last_indexed | 2024-03-10T03:42:03Z |
publishDate | 2022-05-01 |
publisher | MDPI AG |
record_format | Article |
series | Information |
spelling | doaj.art-f4c0dc3499b644f4a553e9485120808b2023-11-23T11:30:03ZengMDPI AGInformation2078-24892022-05-0113523210.3390/info13050232A Forward-Looking Approach to Compare Ranking Methods for SportsPeter Juma Ochieng0András London1Miklós Krész2Institute of Informatics, University of Szeged, 2 Árpád tér, H-6720 Szeged, HungaryInstitute of Informatics, University of Szeged, 2 Árpád tér, H-6720 Szeged, HungaryInnoRenew CoE, Livade 6, 6310 Izola, SloveniaIn this paper, we provide a simple forward-looking approach to compare rating methods with respect to their stability over time. Given a rating vector of entities involved in the comparison and a ranking indicated by the rating, the stability of the methods is measured by the change in rating vector and ranks of the entities over time from a forward-looking perspective. We investigate various linear algebraic rating methods and use the Euclidean distance and Kendall tau rank correlation to measure their stability in rating and ranking, respectively. The investigations are based on both rolling and expanding window approaches. We apply the methodology to sports as a widely known ranking and rating environment. The results suggest that PageRank and Massey rating methods provide better rating and ranking stability than simple methods, such as winning percentage, and more advanced ones, such as Colley’s least square and Keener’s eigenvector-based method. Finally, a simple way to examine the potential predictive power of the rating methods is also provided.https://www.mdpi.com/2078-2489/13/5/232ratingrankingstability |
spellingShingle | Peter Juma Ochieng András London Miklós Krész A Forward-Looking Approach to Compare Ranking Methods for Sports Information rating ranking stability |
title | A Forward-Looking Approach to Compare Ranking Methods for Sports |
title_full | A Forward-Looking Approach to Compare Ranking Methods for Sports |
title_fullStr | A Forward-Looking Approach to Compare Ranking Methods for Sports |
title_full_unstemmed | A Forward-Looking Approach to Compare Ranking Methods for Sports |
title_short | A Forward-Looking Approach to Compare Ranking Methods for Sports |
title_sort | forward looking approach to compare ranking methods for sports |
topic | rating ranking stability |
url | https://www.mdpi.com/2078-2489/13/5/232 |
work_keys_str_mv | AT peterjumaochieng aforwardlookingapproachtocomparerankingmethodsforsports AT andraslondon aforwardlookingapproachtocomparerankingmethodsforsports AT mikloskresz aforwardlookingapproachtocomparerankingmethodsforsports AT peterjumaochieng forwardlookingapproachtocomparerankingmethodsforsports AT andraslondon forwardlookingapproachtocomparerankingmethodsforsports AT mikloskresz forwardlookingapproachtocomparerankingmethodsforsports |