A Forward-Looking Approach to Compare Ranking Methods for Sports

In this paper, we provide a simple forward-looking approach to compare rating methods with respect to their stability over time. Given a rating vector of entities involved in the comparison and a ranking indicated by the rating, the stability of the methods is measured by the change in rating vector...

Full description

Bibliographic Details
Main Authors: Peter Juma Ochieng, András London, Miklós Krész
Format: Article
Language:English
Published: MDPI AG 2022-05-01
Series:Information
Subjects:
Online Access:https://www.mdpi.com/2078-2489/13/5/232
_version_ 1797499060903477248
author Peter Juma Ochieng
András London
Miklós Krész
author_facet Peter Juma Ochieng
András London
Miklós Krész
author_sort Peter Juma Ochieng
collection DOAJ
description In this paper, we provide a simple forward-looking approach to compare rating methods with respect to their stability over time. Given a rating vector of entities involved in the comparison and a ranking indicated by the rating, the stability of the methods is measured by the change in rating vector and ranks of the entities over time from a forward-looking perspective. We investigate various linear algebraic rating methods and use the Euclidean distance and Kendall tau rank correlation to measure their stability in rating and ranking, respectively. The investigations are based on both rolling and expanding window approaches. We apply the methodology to sports as a widely known ranking and rating environment. The results suggest that PageRank and Massey rating methods provide better rating and ranking stability than simple methods, such as winning percentage, and more advanced ones, such as Colley’s least square and Keener’s eigenvector-based method. Finally, a simple way to examine the potential predictive power of the rating methods is also provided.
first_indexed 2024-03-10T03:42:03Z
format Article
id doaj.art-f4c0dc3499b644f4a553e9485120808b
institution Directory Open Access Journal
issn 2078-2489
language English
last_indexed 2024-03-10T03:42:03Z
publishDate 2022-05-01
publisher MDPI AG
record_format Article
series Information
spelling doaj.art-f4c0dc3499b644f4a553e9485120808b2023-11-23T11:30:03ZengMDPI AGInformation2078-24892022-05-0113523210.3390/info13050232A Forward-Looking Approach to Compare Ranking Methods for SportsPeter Juma Ochieng0András London1Miklós Krész2Institute of Informatics, University of Szeged, 2 Árpád tér, H-6720 Szeged, HungaryInstitute of Informatics, University of Szeged, 2 Árpád tér, H-6720 Szeged, HungaryInnoRenew CoE, Livade 6, 6310 Izola, SloveniaIn this paper, we provide a simple forward-looking approach to compare rating methods with respect to their stability over time. Given a rating vector of entities involved in the comparison and a ranking indicated by the rating, the stability of the methods is measured by the change in rating vector and ranks of the entities over time from a forward-looking perspective. We investigate various linear algebraic rating methods and use the Euclidean distance and Kendall tau rank correlation to measure their stability in rating and ranking, respectively. The investigations are based on both rolling and expanding window approaches. We apply the methodology to sports as a widely known ranking and rating environment. The results suggest that PageRank and Massey rating methods provide better rating and ranking stability than simple methods, such as winning percentage, and more advanced ones, such as Colley’s least square and Keener’s eigenvector-based method. Finally, a simple way to examine the potential predictive power of the rating methods is also provided.https://www.mdpi.com/2078-2489/13/5/232ratingrankingstability
spellingShingle Peter Juma Ochieng
András London
Miklós Krész
A Forward-Looking Approach to Compare Ranking Methods for Sports
Information
rating
ranking
stability
title A Forward-Looking Approach to Compare Ranking Methods for Sports
title_full A Forward-Looking Approach to Compare Ranking Methods for Sports
title_fullStr A Forward-Looking Approach to Compare Ranking Methods for Sports
title_full_unstemmed A Forward-Looking Approach to Compare Ranking Methods for Sports
title_short A Forward-Looking Approach to Compare Ranking Methods for Sports
title_sort forward looking approach to compare ranking methods for sports
topic rating
ranking
stability
url https://www.mdpi.com/2078-2489/13/5/232
work_keys_str_mv AT peterjumaochieng aforwardlookingapproachtocomparerankingmethodsforsports
AT andraslondon aforwardlookingapproachtocomparerankingmethodsforsports
AT mikloskresz aforwardlookingapproachtocomparerankingmethodsforsports
AT peterjumaochieng forwardlookingapproachtocomparerankingmethodsforsports
AT andraslondon forwardlookingapproachtocomparerankingmethodsforsports
AT mikloskresz forwardlookingapproachtocomparerankingmethodsforsports