Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All
The assessment of multimedia accessibility is a relevant, complex and time-consuming task, which takes more than simply checking whether the video has audiodescription and captions or not. In our study, we face this challenge through the: 1) involvement of a cohort of novice evaluators, who previous...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9427559/ |
| _version_ | 1819139651917578240 |
|---|---|
| author | Elisa M. Molanes-Lopez Alejandro Rodriguez-Ascaso Emilio Leton Jorge Perez-Martin |
| author_facet | Elisa M. Molanes-Lopez Alejandro Rodriguez-Ascaso Emilio Leton Jorge Perez-Martin |
| author_sort | Elisa M. Molanes-Lopez |
| collection | DOAJ |
| description | The assessment of multimedia accessibility is a relevant, complex and time-consuming task, which takes more than simply checking whether the video has audiodescription and captions or not. In our study, we face this challenge through the: 1) involvement of a cohort of novice evaluators, who previously took part in a MOOC on the accessibility of digital content and 2) the division of the accessibility assessment into the application of a set of criteria. Two groups of novice accessibility testers were asked to evaluate the accessibility of two similar videos, one video per group. While both videos were equivalent in terms of their pedagogical content, only one of them had non-severe accessibility barriers for people with low vision and for blind people. Each participant was asked to rate qualitatively a set of statements extracted from the WCAG 2.1 success criteria, one generic statement about the video accessibility, and a set of statements on the quality perception and the aspects of personal preference. The largest differences in ratings occurred for statements whose success criteria had been improved. It was also the case for one success criterion that is understandable but hardly applicable by novice evaluators, according to the literature. However, the difference was statistically significant only for the success criterion with more salient differences between both videos. As a main conclusion, a group of novice evaluators can identify accessibility problems in videos when using specific accessibility statements. |
| first_indexed | 2024-12-22T11:26:03Z |
| format | Article |
| id | doaj.art-ffdd9ff2bc3440de880b575a43fc08d9 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-22T11:26:03Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ffdd9ff2bc3440de880b575a43fc08d92022-12-21T18:27:45ZengIEEEIEEE Access2169-35362021-01-019723577236710.1109/ACCESS.2021.30791999427559Assessment of Video Accessibility by Students of a MOOC on Digital Materials for AllElisa M. Molanes-Lopez0https://orcid.org/0000-0003-3217-8551Alejandro Rodriguez-Ascaso1https://orcid.org/0000-0002-7092-4538Emilio Leton2https://orcid.org/0000-0001-6908-9590Jorge Perez-Martin3https://orcid.org/0000-0002-3588-7233Department of Statistics and Operations Research, Faculty of Medicine, Universidad Complutense de Madrid (UCM), Madrid, SpainDepartment of Artificial Intelligence, Universidad Nacional de Educación a Distancia (UNED), Madrid, SpainDepartment of Artificial Intelligence, Universidad Nacional de Educación a Distancia (UNED), Madrid, SpainDepartment of Artificial Intelligence, Universidad Nacional de Educación a Distancia (UNED), Madrid, SpainThe assessment of multimedia accessibility is a relevant, complex and time-consuming task, which takes more than simply checking whether the video has audiodescription and captions or not. In our study, we face this challenge through the: 1) involvement of a cohort of novice evaluators, who previously took part in a MOOC on the accessibility of digital content and 2) the division of the accessibility assessment into the application of a set of criteria. Two groups of novice accessibility testers were asked to evaluate the accessibility of two similar videos, one video per group. While both videos were equivalent in terms of their pedagogical content, only one of them had non-severe accessibility barriers for people with low vision and for blind people. Each participant was asked to rate qualitatively a set of statements extracted from the WCAG 2.1 success criteria, one generic statement about the video accessibility, and a set of statements on the quality perception and the aspects of personal preference. The largest differences in ratings occurred for statements whose success criteria had been improved. It was also the case for one success criterion that is understandable but hardly applicable by novice evaluators, according to the literature. However, the difference was statistically significant only for the success criterion with more salient differences between both videos. As a main conclusion, a group of novice evaluators can identify accessibility problems in videos when using specific accessibility statements.https://ieeexplore.ieee.org/document/9427559/Accessibilityevaluationhuman computer interactionsocialvideo |
| spellingShingle | Elisa M. Molanes-Lopez Alejandro Rodriguez-Ascaso Emilio Leton Jorge Perez-Martin Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All IEEE Access Accessibility evaluation human computer interaction social video |
| title | Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All |
| title_full | Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All |
| title_fullStr | Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All |
| title_full_unstemmed | Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All |
| title_short | Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All |
| title_sort | assessment of video accessibility by students of a mooc on digital materials for all |
| topic | Accessibility evaluation human computer interaction social video |
| url | https://ieeexplore.ieee.org/document/9427559/ |
| work_keys_str_mv | AT elisammolaneslopez assessmentofvideoaccessibilitybystudentsofamoocondigitalmaterialsforall AT alejandrorodriguezascaso assessmentofvideoaccessibilitybystudentsofamoocondigitalmaterialsforall AT emilioleton assessmentofvideoaccessibilitybystudentsofamoocondigitalmaterialsforall AT jorgeperezmartin assessmentofvideoaccessibilitybystudentsofamoocondigitalmaterialsforall |