Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming

Despite the growing popularity of Virtual Reality (VR), 360-degree videos are often regarded as challenging to stream due to their large bandwidth requirement. As a solution, the 360-degree video content is spatially divided into tiles, and the quality level for each tile is selected based on the us...

Full description

Bibliographic Details
Main Authors: Kiana Dziubinski, Masaki Bandai
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9877814/
_version_ 1798033658051821568
author Kiana Dziubinski
Masaki Bandai
author_facet Kiana Dziubinski
Masaki Bandai
author_sort Kiana Dziubinski
collection DOAJ
description Despite the growing popularity of Virtual Reality (VR), 360-degree videos are often regarded as challenging to stream due to their large bandwidth requirement. As a solution, the 360-degree video content is spatially divided into tiles, and the quality level for each tile is selected based on the user’s network environment and viewport information. To determine the high quality tiles, viewport prediction and viewport history methods are used to estimate the user’s viewport. However, due to the unpredictability of user head movements, generating accurate viewport estimates are difficult, which can severely degrade the Quality of Experience (QoE) for the user. In this paper, to sustain high user QoE, we detail a novel tile quality selection algorithm that employs viewport prediction, viewport history, viewport extensions, and a viewport tile count limit. In addition, we also include comparison analysis on six 360-degree videos that vary in content pace. Based from simulations, using viewport history as a heuristic for tile quality selection demonstrated a significant increase in the perceived quality while suppressing quality variation inside the viewport and across segments compared to eight reference methods; and secondly, 360-degree videos slow in content pace tended to result in lower viewport prediction accuracy, QoE performance, and weaker viewport history trends compared to 360-degree videos fast in content pace.
first_indexed 2024-04-11T20:32:36Z
format Article
id doaj.art-a35826f5b4a842ebb23234d865021a06
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-11T20:32:36Z
publishDate 2022-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-a35826f5b4a842ebb23234d865021a062022-12-22T04:04:27ZengIEEEIEEE Access2169-35362022-01-0110946529466710.1109/ACCESS.2022.32043319877814Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video StreamingKiana Dziubinski0Masaki Bandai1https://orcid.org/0000-0003-3184-1331Faculty of Science and Technology, Sophia University, Tokyo, JapanFaculty of Science and Technology, Sophia University, Tokyo, JapanDespite the growing popularity of Virtual Reality (VR), 360-degree videos are often regarded as challenging to stream due to their large bandwidth requirement. As a solution, the 360-degree video content is spatially divided into tiles, and the quality level for each tile is selected based on the user’s network environment and viewport information. To determine the high quality tiles, viewport prediction and viewport history methods are used to estimate the user’s viewport. However, due to the unpredictability of user head movements, generating accurate viewport estimates are difficult, which can severely degrade the Quality of Experience (QoE) for the user. In this paper, to sustain high user QoE, we detail a novel tile quality selection algorithm that employs viewport prediction, viewport history, viewport extensions, and a viewport tile count limit. In addition, we also include comparison analysis on six 360-degree videos that vary in content pace. Based from simulations, using viewport history as a heuristic for tile quality selection demonstrated a significant increase in the perceived quality while suppressing quality variation inside the viewport and across segments compared to eight reference methods; and secondly, 360-degree videos slow in content pace tended to result in lower viewport prediction accuracy, QoE performance, and weaker viewport history trends compared to 360-degree videos fast in content pace.https://ieeexplore.ieee.org/document/9877814/360-degree video streamingadaptive streamingvirtual reality (VR)
spellingShingle Kiana Dziubinski
Masaki Bandai
Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
IEEE Access
360-degree video streaming
adaptive streaming
virtual reality (VR)
title Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
title_full Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
title_fullStr Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
title_full_unstemmed Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
title_short Viewport History as a Heuristic for Quality Enhancement and Quality Variation Control in Viewport-Aware Tile-Based 360-Degree Video Streaming
title_sort viewport history as a heuristic for quality enhancement and quality variation control in viewport aware tile based 360 degree video streaming
topic 360-degree video streaming
adaptive streaming
virtual reality (VR)
url https://ieeexplore.ieee.org/document/9877814/
work_keys_str_mv AT kianadziubinski viewporthistoryasaheuristicforqualityenhancementandqualityvariationcontrolinviewportawaretilebased360degreevideostreaming
AT masakibandai viewporthistoryasaheuristicforqualityenhancementandqualityvariationcontrolinviewportawaretilebased360degreevideostreaming