360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos

The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360-degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realiz...

Full description

Bibliographic Details
Main Authors: Lu Yujun, Takuya Fujihashi, Shunsuke Saruwatari, Takashi Watanabe
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9381238/
_version_ 1818947015273349120
author Lu Yujun
Takuya Fujihashi
Shunsuke Saruwatari
Takashi Watanabe
author_facet Lu Yujun
Takuya Fujihashi
Shunsuke Saruwatari
Takashi Watanabe
author_sort Lu Yujun
collection DOAJ
description The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360-degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems.
first_indexed 2024-12-20T08:24:11Z
format Article
id doaj.art-7c083acfaae046949ef46a7a2c0dd616
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-20T08:24:11Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-7c083acfaae046949ef46a7a2c0dd6162022-12-21T19:46:53ZengIEEEIEEE Access2169-35362021-01-019526845269710.1109/ACCESS.2021.30670189381238360Cast+: Viewport Adaptive Soft Delivery for 360-Degree VideosLu Yujun0https://orcid.org/0000-0002-1842-9054Takuya Fujihashi1https://orcid.org/0000-0002-6960-0122Shunsuke Saruwatari2https://orcid.org/0000-0002-1625-5521Takashi Watanabe3https://orcid.org/0000-0002-3227-9048Graduate School of Information Science and Technology, Osaka University, Osaka, JapanGraduate School of Information Science and Technology, Osaka University, Osaka, JapanGraduate School of Information Science and Technology, Osaka University, Osaka, JapanGraduate School of Information Science and Technology, Osaka University, Osaka, JapanThe existing viewport-adaptive 360-degree video streaming schemes encode tiled 360-degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems.https://ieeexplore.ieee.org/document/9381238/360-degree video deliverysoft deliveryviewport adaptive
spellingShingle Lu Yujun
Takuya Fujihashi
Shunsuke Saruwatari
Takashi Watanabe
360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
IEEE Access
360-degree video delivery
soft delivery
viewport adaptive
title 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
title_full 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
title_fullStr 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
title_full_unstemmed 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
title_short 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
title_sort 360cast x002b viewport adaptive soft delivery for 360 degree videos
topic 360-degree video delivery
soft delivery
viewport adaptive
url https://ieeexplore.ieee.org/document/9381238/
work_keys_str_mv AT luyujun 360castx002bviewportadaptivesoftdeliveryfor360degreevideos
AT takuyafujihashi 360castx002bviewportadaptivesoftdeliveryfor360degreevideos
AT shunsukesaruwatari 360castx002bviewportadaptivesoftdeliveryfor360degreevideos
AT takashiwatanabe 360castx002bviewportadaptivesoftdeliveryfor360degreevideos