Reliability of live and video-based coding in netball using the NetballStats application
Understanding reliability of performance analysis tools is important to ensure match to match comparisons can be undertaken with the knowledge of consistency between coding situations. There are few published studies examining the reliability of commonly used performance analysis tools. The aim of t...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9212167/?tool=EBI |
| _version_ | 1811334021651628032 |
|---|---|
| author | Lyndell Bruce Dan Dwyer Aaron Fox |
| author_facet | Lyndell Bruce Dan Dwyer Aaron Fox |
| author_sort | Lyndell Bruce |
| collection | DOAJ |
| description | Understanding reliability of performance analysis tools is important to ensure match to match comparisons can be undertaken with the knowledge of consistency between coding situations. There are few published studies examining the reliability of commonly used performance analysis tools. The aim of this project was to assess the inter- and intra-rater reliability of the NetballStats application and to make comparisons between live and video-based coding situations. Two ‘coders’ coded eight netball matches using the NetballStats application, coding each match live, then twice from video. Level of agreement was assessed for frequency counts across the variables coded. Results showed that intra-rater agreement was higher than inter-rater agreement and that reliability from video coding is better than from live coding. High frequency events automatically coded by the application and events that are well defined had greater levels of agreement than lower frequency events and subjectively judged events. Live coding situations underrepresent occurrence of events, particularly for high frequency events such as ‘possession’. To ensure reliability between coders, clubs should provide an extensive training program to coders with clear instructions on coding subjective events. Coaches should be aware that live coding underestimates some event types and factor this into their decision making processes. |
| first_indexed | 2024-04-13T17:01:34Z |
| format | Article |
| id | doaj.art-9e409a211b134917947f4fe6504f5155 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-13T17:01:34Z |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-9e409a211b134917947f4fe6504f51552022-12-22T02:38:38ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-01176Reliability of live and video-based coding in netball using the NetballStats applicationLyndell BruceDan DwyerAaron FoxUnderstanding reliability of performance analysis tools is important to ensure match to match comparisons can be undertaken with the knowledge of consistency between coding situations. There are few published studies examining the reliability of commonly used performance analysis tools. The aim of this project was to assess the inter- and intra-rater reliability of the NetballStats application and to make comparisons between live and video-based coding situations. Two ‘coders’ coded eight netball matches using the NetballStats application, coding each match live, then twice from video. Level of agreement was assessed for frequency counts across the variables coded. Results showed that intra-rater agreement was higher than inter-rater agreement and that reliability from video coding is better than from live coding. High frequency events automatically coded by the application and events that are well defined had greater levels of agreement than lower frequency events and subjectively judged events. Live coding situations underrepresent occurrence of events, particularly for high frequency events such as ‘possession’. To ensure reliability between coders, clubs should provide an extensive training program to coders with clear instructions on coding subjective events. Coaches should be aware that live coding underestimates some event types and factor this into their decision making processes.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9212167/?tool=EBI |
| spellingShingle | Lyndell Bruce Dan Dwyer Aaron Fox Reliability of live and video-based coding in netball using the NetballStats application PLoS ONE |
| title | Reliability of live and video-based coding in netball using the NetballStats application |
| title_full | Reliability of live and video-based coding in netball using the NetballStats application |
| title_fullStr | Reliability of live and video-based coding in netball using the NetballStats application |
| title_full_unstemmed | Reliability of live and video-based coding in netball using the NetballStats application |
| title_short | Reliability of live and video-based coding in netball using the NetballStats application |
| title_sort | reliability of live and video based coding in netball using the netballstats application |
| url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9212167/?tool=EBI |
| work_keys_str_mv | AT lyndellbruce reliabilityofliveandvideobasedcodinginnetballusingthenetballstatsapplication AT dandwyer reliabilityofliveandvideobasedcodinginnetballusingthenetballstatsapplication AT aaronfox reliabilityofliveandvideobasedcodinginnetballusingthenetballstatsapplication |