Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding

Versatile video coding (VVC) adopts an advanced quad-tree plus multi-type tree (QTMT) coding structure to obtain higher compression efficiency, but it comes at the cost of a considerable increase in coding complexity. To effectively reduce the coding complexity of the QTMT-based coding unit (CU) par...

Full description

Bibliographic Details
Main Authors: Yue Li, Fei Luo, Yapei Zhu
Format: Article
Language:English
Published: MDPI AG 2022-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/20/7741
_version_ 1797470016622297088
author Yue Li
Fei Luo
Yapei Zhu
author_facet Yue Li
Fei Luo
Yapei Zhu
author_sort Yue Li
collection DOAJ
description Versatile video coding (VVC) adopts an advanced quad-tree plus multi-type tree (QTMT) coding structure to obtain higher compression efficiency, but it comes at the cost of a considerable increase in coding complexity. To effectively reduce the coding complexity of the QTMT-based coding unit (CU) partition, we propose a fast inter CU partition method based on a temporal prediction model, which includes early termination QTMT partition and early skipping multi-type tree (MT) partition. Firstly, according to the position of the current CU, we extract the optimal CU partition information of the position corresponding to the previously coded frames. We then establish a temporal prediction model based on temporal CU partition information to predict the current CU partition. Finally, to reduce the cumulative of errors of the temporal prediction model, we further extract the motion vector difference (MVD) of the CU to determine whether the QTMT partition can be terminated early. The experimental results show that the proposed method can reduce the inter coding complexity of VVC by 23.19% on average, while the Bjontegaard delta bit rate (BDBR) is only increased by 0.97% on average under the Random Access (RA) configuration.
first_indexed 2024-03-09T19:30:46Z
format Article
id doaj.art-81738156f4a2462192cc55119d3a7af4
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T19:30:46Z
publishDate 2022-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-81738156f4a2462192cc55119d3a7af42023-11-24T02:24:59ZengMDPI AGSensors1424-82202022-10-012220774110.3390/s22207741Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video CodingYue Li0Fei Luo1Yapei Zhu2College of Computer Science, University of South China, Hengyang 421001, ChinaCollege of Computer Science, University of South China, Hengyang 421001, ChinaFaculty of Physics and Electronic Information Science, Hengyang Normal University, Hengyang 421002, ChinaVersatile video coding (VVC) adopts an advanced quad-tree plus multi-type tree (QTMT) coding structure to obtain higher compression efficiency, but it comes at the cost of a considerable increase in coding complexity. To effectively reduce the coding complexity of the QTMT-based coding unit (CU) partition, we propose a fast inter CU partition method based on a temporal prediction model, which includes early termination QTMT partition and early skipping multi-type tree (MT) partition. Firstly, according to the position of the current CU, we extract the optimal CU partition information of the position corresponding to the previously coded frames. We then establish a temporal prediction model based on temporal CU partition information to predict the current CU partition. Finally, to reduce the cumulative of errors of the temporal prediction model, we further extract the motion vector difference (MVD) of the CU to determine whether the QTMT partition can be terminated early. The experimental results show that the proposed method can reduce the inter coding complexity of VVC by 23.19% on average, while the Bjontegaard delta bit rate (BDBR) is only increased by 0.97% on average under the Random Access (RA) configuration.https://www.mdpi.com/1424-8220/22/20/7741versatile video codingQTMTCU partitiontemporal prediction model
spellingShingle Yue Li
Fei Luo
Yapei Zhu
Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding
Sensors
versatile video coding
QTMT
CU partition
temporal prediction model
title Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding
title_full Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding
title_fullStr Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding
title_full_unstemmed Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding
title_short Temporal Prediction Model-Based Fast Inter CU Partition for Versatile Video Coding
title_sort temporal prediction model based fast inter cu partition for versatile video coding
topic versatile video coding
QTMT
CU partition
temporal prediction model
url https://www.mdpi.com/1424-8220/22/20/7741
work_keys_str_mv AT yueli temporalpredictionmodelbasedfastintercupartitionforversatilevideocoding
AT feiluo temporalpredictionmodelbasedfastintercupartitionforversatilevideocoding
AT yapeizhu temporalpredictionmodelbasedfastintercupartitionforversatilevideocoding