Comparing subjective and objective evaluations of player performance in Australian Rules football.

Player evaluation plays a fundamental role in the decision-making processes of professional sporting organisations. In the Australian Football League, both subjective and objective evaluations of player match performance are commonplace. This study aimed to identify the extent to which performance i...

Full description

Bibliographic Details
Main Authors: Sam McIntosh, Stephanie Kovalchik, Sam Robertson
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2019-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0220901
_version_ 1797820450344009728
author Sam McIntosh
Stephanie Kovalchik
Sam Robertson
author_facet Sam McIntosh
Stephanie Kovalchik
Sam Robertson
author_sort Sam McIntosh
collection DOAJ
description Player evaluation plays a fundamental role in the decision-making processes of professional sporting organisations. In the Australian Football League, both subjective and objective evaluations of player match performance are commonplace. This study aimed to identify the extent to which performance indicators can explain subjective ratings of player performance. A secondary aim was to compare subjective and objective ratings of player performance. Inside Football Player Ratings (IFPR) and Australian Football League Player Ratings were collected as subjective and objective evaluations of player performance, respectively, for each player during all 1026 matches throughout the 2013-2017 Australian Football League seasons. Nine common player performance indicators, player role classification, player age and match outcomes were also collected. Standardised linear mixed model and recursive partitioning and regression tree models were undertaken across the whole dataset, as well as separately for each of the seven player roles. The mixed model analysis produced a model associating the performance indicators with IFPR at a root mean square error of 0.98. Random effects accounting for differences between seasons and players ranged by 0.09 and 1.73 IFPR each across the five seasons and 1052 players, respectively. The recursive partitioning and regression tree model explained IFPR exactly in 35.8% of instances, and to within 1.0 IFPR point in 81.0% of instances. When analysed separately by player role, exact explanation varied from 25.2% to 41.7%, and within 1.0 IFPR point from 70.3% to 88.6%. Overall, kicks and handballs were most associated with the IFPR. This study highlights that a select few features account for a majority of the variance when explaining subjective ratings of player performance, and that these vary by player role. Australian Football League organisations should utilise both subjective and objective assessments of performance to gain a better understanding of the differences associated with subjective performance assessment.
first_indexed 2024-03-13T09:38:32Z
format Article
id doaj.art-8a348d3f7de644219ff978f53b02c282
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-03-13T09:38:32Z
publishDate 2019-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-8a348d3f7de644219ff978f53b02c2822023-05-25T05:31:38ZengPublic Library of Science (PLoS)PLoS ONE1932-62032019-01-01148e022090110.1371/journal.pone.0220901Comparing subjective and objective evaluations of player performance in Australian Rules football.Sam McIntoshStephanie KovalchikSam RobertsonPlayer evaluation plays a fundamental role in the decision-making processes of professional sporting organisations. In the Australian Football League, both subjective and objective evaluations of player match performance are commonplace. This study aimed to identify the extent to which performance indicators can explain subjective ratings of player performance. A secondary aim was to compare subjective and objective ratings of player performance. Inside Football Player Ratings (IFPR) and Australian Football League Player Ratings were collected as subjective and objective evaluations of player performance, respectively, for each player during all 1026 matches throughout the 2013-2017 Australian Football League seasons. Nine common player performance indicators, player role classification, player age and match outcomes were also collected. Standardised linear mixed model and recursive partitioning and regression tree models were undertaken across the whole dataset, as well as separately for each of the seven player roles. The mixed model analysis produced a model associating the performance indicators with IFPR at a root mean square error of 0.98. Random effects accounting for differences between seasons and players ranged by 0.09 and 1.73 IFPR each across the five seasons and 1052 players, respectively. The recursive partitioning and regression tree model explained IFPR exactly in 35.8% of instances, and to within 1.0 IFPR point in 81.0% of instances. When analysed separately by player role, exact explanation varied from 25.2% to 41.7%, and within 1.0 IFPR point from 70.3% to 88.6%. Overall, kicks and handballs were most associated with the IFPR. This study highlights that a select few features account for a majority of the variance when explaining subjective ratings of player performance, and that these vary by player role. Australian Football League organisations should utilise both subjective and objective assessments of performance to gain a better understanding of the differences associated with subjective performance assessment.https://doi.org/10.1371/journal.pone.0220901
spellingShingle Sam McIntosh
Stephanie Kovalchik
Sam Robertson
Comparing subjective and objective evaluations of player performance in Australian Rules football.
PLoS ONE
title Comparing subjective and objective evaluations of player performance in Australian Rules football.
title_full Comparing subjective and objective evaluations of player performance in Australian Rules football.
title_fullStr Comparing subjective and objective evaluations of player performance in Australian Rules football.
title_full_unstemmed Comparing subjective and objective evaluations of player performance in Australian Rules football.
title_short Comparing subjective and objective evaluations of player performance in Australian Rules football.
title_sort comparing subjective and objective evaluations of player performance in australian rules football
url https://doi.org/10.1371/journal.pone.0220901
work_keys_str_mv AT sammcintosh comparingsubjectiveandobjectiveevaluationsofplayerperformanceinaustralianrulesfootball
AT stephaniekovalchik comparingsubjectiveandobjectiveevaluationsofplayerperformanceinaustralianrulesfootball
AT samrobertson comparingsubjectiveandobjectiveevaluationsofplayerperformanceinaustralianrulesfootball