VVC Subpicture-Based Frame Packing for MPEG Immersive Video

The moving picture experts group (MPEG) video coding group started an immersive video coding standard project to accomplish acceptable bandwidth and decoding resources for multiple immersive videos with texture (color) and geometry (depth) information. The MPEG immersive video (MIV) coding standard...

Full description

Bibliographic Details
Main Authors: Jong-Beom Jeong, Soonbin Lee, Eun-Seok Ryu
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9893812/
_version_ 1797996515019456512
author Jong-Beom Jeong
Soonbin Lee
Eun-Seok Ryu
author_facet Jong-Beom Jeong
Soonbin Lee
Eun-Seok Ryu
author_sort Jong-Beom Jeong
collection DOAJ
description The moving picture experts group (MPEG) video coding group started an immersive video coding standard project to accomplish acceptable bandwidth and decoding resources for multiple immersive videos with texture (color) and geometry (depth) information. The MPEG immersive video (MIV) coding standard provides functionality to remove inter-view redundancy and merge the residuals into videos defined as atlases. Although MIV reduces the number of videos to decode, an efficient decoder instance reduction method has not been actively investigated. This paper proposes a frame packing implementation in MIV software. The proposed method conducts frame packing for geometry atlases to align with texture atlases, encodes them as subpicture bitstreams, and merges one texture / geometry atlas into a single bitstream with a bitstream merger. Furthermore, the proposed method provides control over the number of decoder instances without significantly increasing the computational complexity compared to existing frame packing methods. Therefore, the proposed method was accepted in MIV and will be implemented on the recent version of the reference software of MIV.
first_indexed 2024-04-11T10:17:39Z
format Article
id doaj.art-bd4e39d9c86f4c98aa036135572c5d91
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-11T10:17:39Z
publishDate 2022-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-bd4e39d9c86f4c98aa036135572c5d912022-12-22T04:29:53ZengIEEEIEEE Access2169-35362022-01-011010378110379210.1109/ACCESS.2022.32071549893812VVC Subpicture-Based Frame Packing for MPEG Immersive VideoJong-Beom Jeong0https://orcid.org/0000-0002-7356-5753Soonbin Lee1Eun-Seok Ryu2https://orcid.org/0000-0003-4894-6105Department of Computer Science Education, Sungkyunkwan University (SKKU), Seoul, South KoreaDepartment of Computer Science Education, Sungkyunkwan University (SKKU), Seoul, South KoreaDepartment of Computer Science Education, Sungkyunkwan University (SKKU), Seoul, South KoreaThe moving picture experts group (MPEG) video coding group started an immersive video coding standard project to accomplish acceptable bandwidth and decoding resources for multiple immersive videos with texture (color) and geometry (depth) information. The MPEG immersive video (MIV) coding standard provides functionality to remove inter-view redundancy and merge the residuals into videos defined as atlases. Although MIV reduces the number of videos to decode, an efficient decoder instance reduction method has not been actively investigated. This paper proposes a frame packing implementation in MIV software. The proposed method conducts frame packing for geometry atlases to align with texture atlases, encodes them as subpicture bitstreams, and merges one texture / geometry atlas into a single bitstream with a bitstream merger. Furthermore, the proposed method provides control over the number of decoder instances without significantly increasing the computational complexity compared to existing frame packing methods. Therefore, the proposed method was accepted in MIV and will be implemented on the recent version of the reference software of MIV.https://ieeexplore.ieee.org/document/9893812/Virtual realitymetaversesix degrees of freedomMPEG immersive videoversatile video codingsubpicture
spellingShingle Jong-Beom Jeong
Soonbin Lee
Eun-Seok Ryu
VVC Subpicture-Based Frame Packing for MPEG Immersive Video
IEEE Access
Virtual reality
metaverse
six degrees of freedom
MPEG immersive video
versatile video coding
subpicture
title VVC Subpicture-Based Frame Packing for MPEG Immersive Video
title_full VVC Subpicture-Based Frame Packing for MPEG Immersive Video
title_fullStr VVC Subpicture-Based Frame Packing for MPEG Immersive Video
title_full_unstemmed VVC Subpicture-Based Frame Packing for MPEG Immersive Video
title_short VVC Subpicture-Based Frame Packing for MPEG Immersive Video
title_sort vvc subpicture based frame packing for mpeg immersive video
topic Virtual reality
metaverse
six degrees of freedom
MPEG immersive video
versatile video coding
subpicture
url https://ieeexplore.ieee.org/document/9893812/
work_keys_str_mv AT jongbeomjeong vvcsubpicturebasedframepackingformpegimmersivevideo
AT soonbinlee vvcsubpicturebasedframepackingformpegimmersivevideo
AT eunseokryu vvcsubpicturebasedframepackingformpegimmersivevideo