360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos
The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360-degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realiz...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9381238/ |
_version_ | 1818947015273349120 |
---|---|
author | Lu Yujun Takuya Fujihashi Shunsuke Saruwatari Takashi Watanabe |
author_facet | Lu Yujun Takuya Fujihashi Shunsuke Saruwatari Takashi Watanabe |
author_sort | Lu Yujun |
collection | DOAJ |
description | The existing viewport-adaptive 360-degree video streaming schemes encode tiled 360-degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems. |
first_indexed | 2024-12-20T08:24:11Z |
format | Article |
id | doaj.art-7c083acfaae046949ef46a7a2c0dd616 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-20T08:24:11Z |
publishDate | 2021-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-7c083acfaae046949ef46a7a2c0dd6162022-12-21T19:46:53ZengIEEEIEEE Access2169-35362021-01-019526845269710.1109/ACCESS.2021.30670189381238360Cast+: Viewport Adaptive Soft Delivery for 360-Degree VideosLu Yujun0https://orcid.org/0000-0002-1842-9054Takuya Fujihashi1https://orcid.org/0000-0002-6960-0122Shunsuke Saruwatari2https://orcid.org/0000-0002-1625-5521Takashi Watanabe3https://orcid.org/0000-0002-3227-9048Graduate School of Information Science and Technology, Osaka University, Osaka, JapanGraduate School of Information Science and Technology, Osaka University, Osaka, JapanGraduate School of Information Science and Technology, Osaka University, Osaka, JapanGraduate School of Information Science and Technology, Osaka University, Osaka, JapanThe existing viewport-adaptive 360-degree video streaming schemes encode tiled 360-degree videos with digital-based compression. However, these schemes cause a cliff effect wherein the headset video quality drops when the channel signal-to-noise ratio (SNR) falls below a certain threshold. To realize high-quality wireless 360-degree video streaming, we propose a novel viewport-adaptive soft delivery scheme for 360-degree videos, called 360Cast+. 360Cast+ skips the non-linear operations in digital-based streaming and adopts power allocation and analog modulation to achieve graceful video quality improvement in unstable wireless links. In particular, 360Cast+ integrates the human vision system (HVS) and projection distortion as a perceptual weight in power allocation operations. A near-optimal low-complexity subcarrier matching algorithm was also adopted to extend 360Cast+ to fading channel environments. To reduce the effect of the prediction error, 360Cast+ uses dynamic linear regression (DLR) to predict the future orientation and future prediction error to extract the extension area around a viewport. The evaluation results demonstrated that the proposed 360Cast+ provides sophisticated video quality irrespective of the prediction error and channel conditions in orthogonal frequency-division multiplexing (OFDM)-based systems.https://ieeexplore.ieee.org/document/9381238/360-degree video deliverysoft deliveryviewport adaptive |
spellingShingle | Lu Yujun Takuya Fujihashi Shunsuke Saruwatari Takashi Watanabe 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos IEEE Access 360-degree video delivery soft delivery viewport adaptive |
title | 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos |
title_full | 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos |
title_fullStr | 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos |
title_full_unstemmed | 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos |
title_short | 360Cast+: Viewport Adaptive Soft Delivery for 360-Degree Videos |
title_sort | 360cast x002b viewport adaptive soft delivery for 360 degree videos |
topic | 360-degree video delivery soft delivery viewport adaptive |
url | https://ieeexplore.ieee.org/document/9381238/ |
work_keys_str_mv | AT luyujun 360castx002bviewportadaptivesoftdeliveryfor360degreevideos AT takuyafujihashi 360castx002bviewportadaptivesoftdeliveryfor360degreevideos AT shunsukesaruwatari 360castx002bviewportadaptivesoftdeliveryfor360degreevideos AT takashiwatanabe 360castx002bviewportadaptivesoftdeliveryfor360degreevideos |