Subjective and Objective Quality Assessment of High Frame Rate Videos
High frame rate (HFR) videos are becoming increasingly common with the tremendous popularity of live, high-action streaming content such as sports. Although HFR contents are generally of very high quality, high bandwidth requirements make them challenging to deliver efficiently, while simultaneously...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9497087/ |
| _version_ | 1818692161891205120 |
|---|---|
| author | Pavan C. Madhusudana Xiangxu Yu Neil Birkbeck Yilin Wang Balu Adsumilli Alan C. Bovik |
| author_facet | Pavan C. Madhusudana Xiangxu Yu Neil Birkbeck Yilin Wang Balu Adsumilli Alan C. Bovik |
| author_sort | Pavan C. Madhusudana |
| collection | DOAJ |
| description | High frame rate (HFR) videos are becoming increasingly common with the tremendous popularity of live, high-action streaming content such as sports. Although HFR contents are generally of very high quality, high bandwidth requirements make them challenging to deliver efficiently, while simultaneously maintaining their quality. To optimize trade-offs between bandwidth requirements and video quality, in terms of frame rate adaptation, it is imperative to understand the intricate relationship between frame rate and perceptual video quality. Towards advancing progression in this direction we designed a new subjective resource, called the LIVE-YouTube-HFR (LIVE-YT-HFR) dataset, which is comprised of 480 videos having 6 different frame rates, obtained from 16 diverse contents. In order to understand the combined effects of compression and frame rate adjustment, we also processed videos at 5 compression levels at each frame rate. To obtain subjective labels on the videos, we conducted a human study yielding 19,000 human quality ratings obtained from a pool of 85 human subjects. We also conducted a holistic evaluation of existing state-of-the-art Full and No-Reference video quality algorithms, and statistically benchmarked their performance on the new database. The LIVE-YT-HFR database has been made available online for public use and evaluation purposes, with hopes that it will help advance research in this exciting video technology direction. It may be obtained at <uri>https://live.ece.utexas.edu/research/LIVE_YT_HFR/LIVE_YT_HFR/index.html</uri>. |
| first_indexed | 2024-12-17T12:53:24Z |
| format | Article |
| id | doaj.art-662f6a889e5347e68a9d60767da839bf |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-17T12:53:24Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-662f6a889e5347e68a9d60767da839bf2022-12-21T21:47:33ZengIEEEIEEE Access2169-35362021-01-01910806910808210.1109/ACCESS.2021.31004629497087Subjective and Objective Quality Assessment of High Frame Rate VideosPavan C. Madhusudana0https://orcid.org/0000-0002-1333-7097Xiangxu Yu1https://orcid.org/0000-0002-2710-2969Neil Birkbeck2Yilin Wang3Balu Adsumilli4Alan C. Bovik5Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, USAGoogle, Mountain View, CA, USAGoogle, Mountain View, CA, USAGoogle, Mountain View, CA, USAGoogle, Mountain View, CA, USADepartment of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, USAHigh frame rate (HFR) videos are becoming increasingly common with the tremendous popularity of live, high-action streaming content such as sports. Although HFR contents are generally of very high quality, high bandwidth requirements make them challenging to deliver efficiently, while simultaneously maintaining their quality. To optimize trade-offs between bandwidth requirements and video quality, in terms of frame rate adaptation, it is imperative to understand the intricate relationship between frame rate and perceptual video quality. Towards advancing progression in this direction we designed a new subjective resource, called the LIVE-YouTube-HFR (LIVE-YT-HFR) dataset, which is comprised of 480 videos having 6 different frame rates, obtained from 16 diverse contents. In order to understand the combined effects of compression and frame rate adjustment, we also processed videos at 5 compression levels at each frame rate. To obtain subjective labels on the videos, we conducted a human study yielding 19,000 human quality ratings obtained from a pool of 85 human subjects. We also conducted a holistic evaluation of existing state-of-the-art Full and No-Reference video quality algorithms, and statistically benchmarked their performance on the new database. The LIVE-YT-HFR database has been made available online for public use and evaluation purposes, with hopes that it will help advance research in this exciting video technology direction. It may be obtained at <uri>https://live.ece.utexas.edu/research/LIVE_YT_HFR/LIVE_YT_HFR/index.html</uri>.https://ieeexplore.ieee.org/document/9497087/High frame rateobjective algorithm evaluationssubjective qualityvideo quality assessmentvideo quality databasefull reference |
| spellingShingle | Pavan C. Madhusudana Xiangxu Yu Neil Birkbeck Yilin Wang Balu Adsumilli Alan C. Bovik Subjective and Objective Quality Assessment of High Frame Rate Videos IEEE Access High frame rate objective algorithm evaluations subjective quality video quality assessment video quality database full reference |
| title | Subjective and Objective Quality Assessment of High Frame Rate Videos |
| title_full | Subjective and Objective Quality Assessment of High Frame Rate Videos |
| title_fullStr | Subjective and Objective Quality Assessment of High Frame Rate Videos |
| title_full_unstemmed | Subjective and Objective Quality Assessment of High Frame Rate Videos |
| title_short | Subjective and Objective Quality Assessment of High Frame Rate Videos |
| title_sort | subjective and objective quality assessment of high frame rate videos |
| topic | High frame rate objective algorithm evaluations subjective quality video quality assessment video quality database full reference |
| url | https://ieeexplore.ieee.org/document/9497087/ |
| work_keys_str_mv | AT pavancmadhusudana subjectiveandobjectivequalityassessmentofhighframeratevideos AT xiangxuyu subjectiveandobjectivequalityassessmentofhighframeratevideos AT neilbirkbeck subjectiveandobjectivequalityassessmentofhighframeratevideos AT yilinwang subjectiveandobjectivequalityassessmentofhighframeratevideos AT baluadsumilli subjectiveandobjectivequalityassessmentofhighframeratevideos AT alancbovik subjectiveandobjectivequalityassessmentofhighframeratevideos |