Reliability of Judging in DanceSport
PurposeThe aim of this study was to assess the reliability and validity of the new judging system in DanceSport.MethodsEighteen judges rated the 12 best placed adult dancing couples competing at an international competition. They marked each couple on all judging criteria on a 10 level scale. Absolu...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2019-05-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fpsyg.2019.01001/full |
| _version_ | 1831729736100872192 |
|---|---|
| author | Jerneja Premelč Goran Vučković Nic James Bojan Leskošek |
| author_facet | Jerneja Premelč Goran Vučković Nic James Bojan Leskošek |
| author_sort | Jerneja Premelč |
| collection | DOAJ |
| description | PurposeThe aim of this study was to assess the reliability and validity of the new judging system in DanceSport.MethodsEighteen judges rated the 12 best placed adult dancing couples competing at an international competition. They marked each couple on all judging criteria on a 10 level scale. Absolute agreement and consistency of judging were calculated for all main judging criteria and sub-criteria.ResultsA mean correlation of overall judging marks was 0.48. Kendall’s coefficient of concordance for overall marks (W = 0.58) suggesting relatively low agreement among judges. Slightly lower coefficients were found for the artistic part [Partnering skills (W = 0.45) and Choreography and performance (W = 0.49)] compared to the technical part [Technical qualities (W = 0.56) and Movement to music (W = 0.54)]. ICC for overall criteria was low for absolute agreement [ICC(2,3) = 0.62] but higher for consistency [ICC(3,3) = 0.80].ConclusionThe relatively large differences between judges’ marks suggest that judges either disagreed to some extent on the quality of the dancing or used the judging scale in different ways. The biggest concern was standard error of measurement (SEM) which was often larger than the difference between dancers scores suggesting that this judging system lacks validity. This was the first research to assess judging in DanceSport and offers suggestions to potentially improve both its objectivity and validity in the future. |
| first_indexed | 2024-12-21T07:18:26Z |
| format | Article |
| id | doaj.art-fb346e8bb1e34d58bac02dcb9e469961 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-21T07:18:26Z |
| publishDate | 2019-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-fb346e8bb1e34d58bac02dcb9e4699612022-12-21T19:11:50ZengFrontiers Media S.A.Frontiers in Psychology1664-10782019-05-011010.3389/fpsyg.2019.01001454027Reliability of Judging in DanceSportJerneja Premelč0Goran Vučković1Nic James2Bojan Leskošek3Faculty of Sport, University of Ljubljana, Ljubljana, SloveniaFaculty of Sport, University of Ljubljana, Ljubljana, SloveniaSchool of Science and Technology, Middlesex University, London, United KingdomFaculty of Sport, University of Ljubljana, Ljubljana, SloveniaPurposeThe aim of this study was to assess the reliability and validity of the new judging system in DanceSport.MethodsEighteen judges rated the 12 best placed adult dancing couples competing at an international competition. They marked each couple on all judging criteria on a 10 level scale. Absolute agreement and consistency of judging were calculated for all main judging criteria and sub-criteria.ResultsA mean correlation of overall judging marks was 0.48. Kendall’s coefficient of concordance for overall marks (W = 0.58) suggesting relatively low agreement among judges. Slightly lower coefficients were found for the artistic part [Partnering skills (W = 0.45) and Choreography and performance (W = 0.49)] compared to the technical part [Technical qualities (W = 0.56) and Movement to music (W = 0.54)]. ICC for overall criteria was low for absolute agreement [ICC(2,3) = 0.62] but higher for consistency [ICC(3,3) = 0.80].ConclusionThe relatively large differences between judges’ marks suggest that judges either disagreed to some extent on the quality of the dancing or used the judging scale in different ways. The biggest concern was standard error of measurement (SEM) which was often larger than the difference between dancers scores suggesting that this judging system lacks validity. This was the first research to assess judging in DanceSport and offers suggestions to potentially improve both its objectivity and validity in the future.https://www.frontiersin.org/article/10.3389/fpsyg.2019.01001/fullDanceSportballroom dancejudging systemreliabilityvalidityaesthetic sports |
| spellingShingle | Jerneja Premelč Goran Vučković Nic James Bojan Leskošek Reliability of Judging in DanceSport Frontiers in Psychology DanceSport ballroom dance judging system reliability validity aesthetic sports |
| title | Reliability of Judging in DanceSport |
| title_full | Reliability of Judging in DanceSport |
| title_fullStr | Reliability of Judging in DanceSport |
| title_full_unstemmed | Reliability of Judging in DanceSport |
| title_short | Reliability of Judging in DanceSport |
| title_sort | reliability of judging in dancesport |
| topic | DanceSport ballroom dance judging system reliability validity aesthetic sports |
| url | https://www.frontiersin.org/article/10.3389/fpsyg.2019.01001/full |
| work_keys_str_mv | AT jernejapremelc reliabilityofjudgingindancesport AT goranvuckovic reliabilityofjudgingindancesport AT nicjames reliabilityofjudgingindancesport AT bojanleskosek reliabilityofjudgingindancesport |