An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos

Abstract 360-degree videos have become increasingly popular with the application of virtual reality (VR) technology. To encode such kind of videos with ultra-high resolution, an efficient and real-time video encoder becomes a key requirement. The Versatile Video Coding (VVC) standard has good coding...

Full description

Bibliographic Details
Main Authors: Mengmeng Zhang, Yan Hou, Zhi Liu
Format: Article
Language:English
Published: SpringerOpen 2023-05-01
Series:EURASIP Journal on Image and Video Processing
Subjects:
Online Access:https://doi.org/10.1186/s13640-023-00605-0
_version_ 1797817881005654016
author Mengmeng Zhang
Yan Hou
Zhi Liu
author_facet Mengmeng Zhang
Yan Hou
Zhi Liu
author_sort Mengmeng Zhang
collection DOAJ
description Abstract 360-degree videos have become increasingly popular with the application of virtual reality (VR) technology. To encode such kind of videos with ultra-high resolution, an efficient and real-time video encoder becomes a key requirement. The Versatile Video Coding (VVC) standard has good coding performance. However, it has pretty high computational complexity which increasing the application cost of 360-degree videos. Among them, the decision of the quadtree with nested multi-type tree (QTMT) partitioning structure is one of the time-consuming procedures. In this paper, based on the characteristics of 360-degree video with Equirectangular projection (ERP) format, the empirical variogram combined with Mahalanobis distance is introduced to measure the difference between the horizontal and vertical directions of the CU, and a fast partition algorithm is proposed. The experimental results show that the algorithm saves 32.13% of the coding time with only an increase of 0.66% in BDBR.
first_indexed 2024-03-13T09:00:00Z
format Article
id doaj.art-f5aa8e38ff5e4226b0b67f1e0ec384b9
institution Directory Open Access Journal
issn 1687-5281
language English
last_indexed 2024-03-13T09:00:00Z
publishDate 2023-05-01
publisher SpringerOpen
record_format Article
series EURASIP Journal on Image and Video Processing
spelling doaj.art-f5aa8e38ff5e4226b0b67f1e0ec384b92023-05-28T11:25:04ZengSpringerOpenEURASIP Journal on Image and Video Processing1687-52812023-05-012023111810.1186/s13640-023-00605-0An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videosMengmeng Zhang0Yan Hou1Zhi Liu2Beijing Polytechnic CollegeNorth China University of TechnologyNorth China University of TechnologyAbstract 360-degree videos have become increasingly popular with the application of virtual reality (VR) technology. To encode such kind of videos with ultra-high resolution, an efficient and real-time video encoder becomes a key requirement. The Versatile Video Coding (VVC) standard has good coding performance. However, it has pretty high computational complexity which increasing the application cost of 360-degree videos. Among them, the decision of the quadtree with nested multi-type tree (QTMT) partitioning structure is one of the time-consuming procedures. In this paper, based on the characteristics of 360-degree video with Equirectangular projection (ERP) format, the empirical variogram combined with Mahalanobis distance is introduced to measure the difference between the horizontal and vertical directions of the CU, and a fast partition algorithm is proposed. The experimental results show that the algorithm saves 32.13% of the coding time with only an increase of 0.66% in BDBR.https://doi.org/10.1186/s13640-023-00605-0VVCVirtual realityEmpirical variogramIntra codingMahalanobis distance
spellingShingle Mengmeng Zhang
Yan Hou
Zhi Liu
An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos
EURASIP Journal on Image and Video Processing
VVC
Virtual reality
Empirical variogram
Intra coding
Mahalanobis distance
title An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos
title_full An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos
title_fullStr An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos
title_full_unstemmed An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos
title_short An early CU partition mode decision algorithm in VVC based on variogram for virtual reality 360 degree videos
title_sort early cu partition mode decision algorithm in vvc based on variogram for virtual reality 360 degree videos
topic VVC
Virtual reality
Empirical variogram
Intra coding
Mahalanobis distance
url https://doi.org/10.1186/s13640-023-00605-0
work_keys_str_mv AT mengmengzhang anearlycupartitionmodedecisionalgorithminvvcbasedonvariogramforvirtualreality360degreevideos
AT yanhou anearlycupartitionmodedecisionalgorithminvvcbasedonvariogramforvirtualreality360degreevideos
AT zhiliu anearlycupartitionmodedecisionalgorithminvvcbasedonvariogramforvirtualreality360degreevideos
AT mengmengzhang earlycupartitionmodedecisionalgorithminvvcbasedonvariogramforvirtualreality360degreevideos
AT yanhou earlycupartitionmodedecisionalgorithminvvcbasedonvariogramforvirtualreality360degreevideos
AT zhiliu earlycupartitionmodedecisionalgorithminvvcbasedonvariogramforvirtualreality360degreevideos