Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory

The paper presents the results of subjective and objective quality assessments of H.264-, H.265-, and VP9-encoded video. Most of the literature is devoted to subjective quality assessment in well-defined laboratory circumstances. However, the end users usually watch the films in their home environme...

Full description

Bibliographic Details
Main Authors: Janusz Klink, Stefan Brachmański, Michał Łuczyński
Format: Article
Language:English
Published: MDPI AG 2023-04-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/13/8/5025
_version_ 1797606467550838784
author Janusz Klink
Stefan Brachmański
Michał Łuczyński
author_facet Janusz Klink
Stefan Brachmański
Michał Łuczyński
author_sort Janusz Klink
collection DOAJ
description The paper presents the results of subjective and objective quality assessments of H.264-, H.265-, and VP9-encoded video. Most of the literature is devoted to subjective quality assessment in well-defined laboratory circumstances. However, the end users usually watch the films in their home environments, which may be different from the conditions recommended for laboratory measurements. This may cause significant differences in the quality assessment scores. Thus, the aim of the research is to show the impact of environmental conditions on the video quality perceived by the user. The subjective assessment was made in two different environments: in the laboratory and in users’ homes, where people often watch movies on their laptops. The video signal was assessed by young viewers who were not experts in the field of quality assessment. The tests were performed taking into account different image resolutions and different bit rates. The research showed strong correlations between the obtained results and the coding bit rates used, and revealed a significant difference between the quality scores obtained in the laboratory and at home. As a conclusion, it must be underlined that the laboratory tests are necessary for comparative purposes, while the assessment of the video quality experienced by end users should be performed under circumstances that are as close as possible to the user’s home environment.
first_indexed 2024-03-11T05:15:36Z
format Article
id doaj.art-091504ffe86242fdab3c6aeb31470fb2
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-11T05:15:36Z
publishDate 2023-04-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-091504ffe86242fdab3c6aeb31470fb22023-11-17T18:12:36ZengMDPI AGApplied Sciences2076-34172023-04-01138502510.3390/app13085025Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the LaboratoryJanusz Klink0Stefan Brachmański1Michał Łuczyński2Department of Telecommunications and Teleinformatics, Faculty of Information and Telecommunication Technology, Wrocław University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370 Wrocław, PolandPhotonics and Microsystems Department of Acoustics, Multimedia and Signal Processing, Faculty of Electronic, Wrocław University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370 Wrocław, PolandPhotonics and Microsystems Department of Acoustics, Multimedia and Signal Processing, Faculty of Electronic, Wrocław University of Science and Technology, Wybrzeże Wyspiańskiego 27, 50-370 Wrocław, PolandThe paper presents the results of subjective and objective quality assessments of H.264-, H.265-, and VP9-encoded video. Most of the literature is devoted to subjective quality assessment in well-defined laboratory circumstances. However, the end users usually watch the films in their home environments, which may be different from the conditions recommended for laboratory measurements. This may cause significant differences in the quality assessment scores. Thus, the aim of the research is to show the impact of environmental conditions on the video quality perceived by the user. The subjective assessment was made in two different environments: in the laboratory and in users’ homes, where people often watch movies on their laptops. The video signal was assessed by young viewers who were not experts in the field of quality assessment. The tests were performed taking into account different image resolutions and different bit rates. The research showed strong correlations between the obtained results and the coding bit rates used, and revealed a significant difference between the quality scores obtained in the laboratory and at home. As a conclusion, it must be underlined that the laboratory tests are necessary for comparative purposes, while the assessment of the video quality experienced by end users should be performed under circumstances that are as close as possible to the user’s home environment.https://www.mdpi.com/2076-3417/13/8/5025video qualityobjective quality assessment methodssubjective quality assessment methodsuser experienceuser perceptionQoE
spellingShingle Janusz Klink
Stefan Brachmański
Michał Łuczyński
Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory
Applied Sciences
video quality
objective quality assessment methods
subjective quality assessment methods
user experience
user perception
QoE
title Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory
title_full Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory
title_fullStr Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory
title_full_unstemmed Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory
title_short Assessment of the Quality of Video Sequences Performed by Viewers at Home and in the Laboratory
title_sort assessment of the quality of video sequences performed by viewers at home and in the laboratory
topic video quality
objective quality assessment methods
subjective quality assessment methods
user experience
user perception
QoE
url https://www.mdpi.com/2076-3417/13/8/5025
work_keys_str_mv AT januszklink assessmentofthequalityofvideosequencesperformedbyviewersathomeandinthelaboratory
AT stefanbrachmanski assessmentofthequalityofvideosequencesperformedbyviewersathomeandinthelaboratory
AT michałłuczynski assessmentofthequalityofvideosequencesperformedbyviewersathomeandinthelaboratory