An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding

The increasing popularity of virtual, augmented, and mixed reality (VR/AR/MR) applications is driving the media industry to explore the creation and delivery of new immersive experiences. One of the trends is volumetric video, which allows users to explore content unconstrained by the traditional tw...

Full description

Bibliographic Details
Main Authors: Lauri Ilola, Lukasz Kondrad, Sebastian Schwarz, Ahmed Hamza
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-04-01
Series:Frontiers in Signal Processing
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frsip.2022.883943/full
_version_ 1811303763343835136
author Lauri Ilola
Lukasz Kondrad
Sebastian Schwarz
Ahmed Hamza
author_facet Lauri Ilola
Lukasz Kondrad
Sebastian Schwarz
Ahmed Hamza
author_sort Lauri Ilola
collection DOAJ
description The increasing popularity of virtual, augmented, and mixed reality (VR/AR/MR) applications is driving the media industry to explore the creation and delivery of new immersive experiences. One of the trends is volumetric video, which allows users to explore content unconstrained by the traditional two-dimensional window of director’s view.The ISO/IEC joint technical committee 1 subcommittee 29, better known as the Moving Pictures Experts Group (MPEG), has recently finalized a group of standards, under the umbrella of Visual Volumetric Video-based Coding (V3C). These standards aim to efficiently code, store, and transport immersive content with 6 degrees of freedom. The V3C family of standards currently consists of three documents: 1) ISO/IEC 23090-5 defines the generic concepts of volumetric video-based coding and its application to dynamic point cloud data; 2) ISO/IEC 23090-12 specifies another application that enables compression of volumetric video content captured by multiple cameras; and 3) ISO/IEC 23090-10 describes how to store and deliver V3C compressed volumetric video content. Each standard leverages the capabilities of traditional 2D video coding and delivery solutions, allowing for re-use of existing infrastructures which facilitates fast deployment of volumetric video.This article provides an overview of the generic concepts of V3C, as defined in ISO/IEC 23090-5. Furthermore, it describes V3C carriage related functionalities specified in ISO/IEC 23090-10 and offers best practices for the community with respect to storage and delivery of volumetric video.
first_indexed 2024-04-13T07:53:48Z
format Article
id doaj.art-96084767433d4bbfb478137f18479c11
institution Directory Open Access Journal
issn 2673-8198
language English
last_indexed 2024-04-13T07:53:48Z
publishDate 2022-04-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Signal Processing
spelling doaj.art-96084767433d4bbfb478137f18479c112022-12-22T02:55:28ZengFrontiers Media S.A.Frontiers in Signal Processing2673-81982022-04-01210.3389/frsip.2022.883943883943An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based CodingLauri Ilola0Lukasz Kondrad1Sebastian Schwarz2Ahmed Hamza3Nokia Solutions and Networks GmbH & Co. KG, Munich, GermanyNokia Solutions and Networks GmbH & Co. KG, Munich, GermanyNokia Solutions and Networks GmbH & Co. KG, Munich, GermanyInterDigital Canada Ltée, Montréal, QC, CanadaThe increasing popularity of virtual, augmented, and mixed reality (VR/AR/MR) applications is driving the media industry to explore the creation and delivery of new immersive experiences. One of the trends is volumetric video, which allows users to explore content unconstrained by the traditional two-dimensional window of director’s view.The ISO/IEC joint technical committee 1 subcommittee 29, better known as the Moving Pictures Experts Group (MPEG), has recently finalized a group of standards, under the umbrella of Visual Volumetric Video-based Coding (V3C). These standards aim to efficiently code, store, and transport immersive content with 6 degrees of freedom. The V3C family of standards currently consists of three documents: 1) ISO/IEC 23090-5 defines the generic concepts of volumetric video-based coding and its application to dynamic point cloud data; 2) ISO/IEC 23090-12 specifies another application that enables compression of volumetric video content captured by multiple cameras; and 3) ISO/IEC 23090-10 describes how to store and deliver V3C compressed volumetric video content. Each standard leverages the capabilities of traditional 2D video coding and delivery solutions, allowing for re-use of existing infrastructures which facilitates fast deployment of volumetric video.This article provides an overview of the generic concepts of V3C, as defined in ISO/IEC 23090-5. Furthermore, it describes V3C carriage related functionalities specified in ISO/IEC 23090-10 and offers best practices for the community with respect to storage and delivery of volumetric video.https://www.frontiersin.org/articles/10.3389/frsip.2022.883943/fullMPEGV3CV-PCCMIVISOBMFFDASH
spellingShingle Lauri Ilola
Lukasz Kondrad
Sebastian Schwarz
Ahmed Hamza
An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding
Frontiers in Signal Processing
MPEG
V3C
V-PCC
MIV
ISOBMFF
DASH
title An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding
title_full An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding
title_fullStr An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding
title_full_unstemmed An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding
title_short An Overview of the MPEG Standard for Storage and Transport of Visual Volumetric Video-Based Coding
title_sort overview of the mpeg standard for storage and transport of visual volumetric video based coding
topic MPEG
V3C
V-PCC
MIV
ISOBMFF
DASH
url https://www.frontiersin.org/articles/10.3389/frsip.2022.883943/full
work_keys_str_mv AT lauriilola anoverviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT lukaszkondrad anoverviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT sebastianschwarz anoverviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT ahmedhamza anoverviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT lauriilola overviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT lukaszkondrad overviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT sebastianschwarz overviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding
AT ahmedhamza overviewofthempegstandardforstorageandtransportofvisualvolumetricvideobasedcoding