Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming
The Moving Picture Experts Group (MPEG) has started an immersive media standard project to enable multi-view video and depth representation in three-dimensional (3D) scenes. The MPEG Immersive Video (MIV) standard technology is intended to provide a limited 6 degrees of freedom (DoF) based on depth...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9899423/ |
| _version_ | 1811204896993574912 |
|---|---|
| author | Soonbin Lee Jong-Beom Jeong Eun-Seok Ryu |
| author_facet | Soonbin Lee Jong-Beom Jeong Eun-Seok Ryu |
| author_sort | Soonbin Lee |
| collection | DOAJ |
| description | The Moving Picture Experts Group (MPEG) has started an immersive media standard project to enable multi-view video and depth representation in three-dimensional (3D) scenes. The MPEG Immersive Video (MIV) standard technology is intended to provide a limited 6 degrees of freedom (DoF) based on depth map-based image rendering (DIBR). The 6DoF immersive video system is still challenging because multiple high-quality video streams require high bandwidth and computing resources. This paper proposes a group-based adaptive rendering method for 6DoF immersive video streaming. With group-based MIV, each group can be transmitted independently, which enables adaptive transmission depending on the user’s viewport. The proposed method derives weights from groups for view synthesis and allocates high-quality bitstreams according to a given viewport. This paper also discussed the results of the group-based approach in the MIV, and the advantages and drawbacks of this approach are detailed. In addition, pixel rate constraint analysis has been introduced to facilitate deployment with existing video codecs. On end-to-end evaluation metrics with TMIV anchor, the proposed method saves average 37.26% Bjontegaard-delta rate (BD-rate) on the peak signal-to-noise ratio (PSNR). |
| first_indexed | 2024-04-12T03:21:23Z |
| format | Article |
| id | doaj.art-ff7ad04f73084429a2f75a4468ccb9b7 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-12T03:21:23Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ff7ad04f73084429a2f75a4468ccb9b72022-12-22T03:49:53ZengIEEEIEEE Access2169-35362022-01-011010269110270010.1109/ACCESS.2022.32085999899423Group-Based Adaptive Rendering System for 6DoF Immersive Video StreamingSoonbin Lee0Jong-Beom Jeong1https://orcid.org/0000-0002-7356-5753Eun-Seok Ryu2https://orcid.org/0000-0003-4894-6105Department of Computer Science Education, Sungkyunkwan University (SKKU), Seoul, South KoreaDepartment of Computer Science Education, Sungkyunkwan University (SKKU), Seoul, South KoreaDepartment of Computer Science Education, Sungkyunkwan University (SKKU), Seoul, South KoreaThe Moving Picture Experts Group (MPEG) has started an immersive media standard project to enable multi-view video and depth representation in three-dimensional (3D) scenes. The MPEG Immersive Video (MIV) standard technology is intended to provide a limited 6 degrees of freedom (DoF) based on depth map-based image rendering (DIBR). The 6DoF immersive video system is still challenging because multiple high-quality video streams require high bandwidth and computing resources. This paper proposes a group-based adaptive rendering method for 6DoF immersive video streaming. With group-based MIV, each group can be transmitted independently, which enables adaptive transmission depending on the user’s viewport. The proposed method derives weights from groups for view synthesis and allocates high-quality bitstreams according to a given viewport. This paper also discussed the results of the group-based approach in the MIV, and the advantages and drawbacks of this approach are detailed. In addition, pixel rate constraint analysis has been introduced to facilitate deployment with existing video codecs. On end-to-end evaluation metrics with TMIV anchor, the proposed method saves average 37.26% Bjontegaard-delta rate (BD-rate) on the peak signal-to-noise ratio (PSNR).https://ieeexplore.ieee.org/document/9899423/Virtual realitymetaverseMPEG immersive video (MIV)adaptive streaming |
| spellingShingle | Soonbin Lee Jong-Beom Jeong Eun-Seok Ryu Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming IEEE Access Virtual reality metaverse MPEG immersive video (MIV) adaptive streaming |
| title | Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming |
| title_full | Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming |
| title_fullStr | Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming |
| title_full_unstemmed | Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming |
| title_short | Group-Based Adaptive Rendering System for 6DoF Immersive Video Streaming |
| title_sort | group based adaptive rendering system for 6dof immersive video streaming |
| topic | Virtual reality metaverse MPEG immersive video (MIV) adaptive streaming |
| url | https://ieeexplore.ieee.org/document/9899423/ |
| work_keys_str_mv | AT soonbinlee groupbasedadaptiverenderingsystemfor6dofimmersivevideostreaming AT jongbeomjeong groupbasedadaptiverenderingsystemfor6dofimmersivevideostreaming AT eunseokryu groupbasedadaptiverenderingsystemfor6dofimmersivevideostreaming |