Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction

The new generation video coding standard Versatile Video Coding (VVC) has adopted many novel technologies to improve compression performance, and consequently, remarkable results have been achieved. In practical applications, less data, in terms of bitrate, would reduce the burden of the sensors and...

Full description

Bibliographic Details
Main Authors: Dan Luo, Shuhua Xiong, Chao Ren, Raymond Edward Sheriff, Xiaohai He
Format: Article
Language:English
Published: MDPI AG 2022-08-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/16/5977
_version_ 1827598501613142016
author Dan Luo
Shuhua Xiong
Chao Ren
Raymond Edward Sheriff
Xiaohai He
author_facet Dan Luo
Shuhua Xiong
Chao Ren
Raymond Edward Sheriff
Xiaohai He
author_sort Dan Luo
collection DOAJ
description The new generation video coding standard Versatile Video Coding (VVC) has adopted many novel technologies to improve compression performance, and consequently, remarkable results have been achieved. In practical applications, less data, in terms of bitrate, would reduce the burden of the sensors and improve their performance. Hence, to further enhance the intra compression performance of VVC, we propose a fusion-based intra prediction algorithm in this paper. Specifically, to better predict areas with similar texture information, we propose a fusion-based adaptive template matching method, which directly takes the error between reference and objective templates into account. Furthermore, to better utilize the correlation between reference pixels and the pixels to be predicted, we propose a fusion-based linear prediction method, which can compensate for the deficiency of single linear prediction. We implemented our algorithm on top of the VVC Test Model (VTM) 9.1. When compared with the VVC, our proposed fusion-based algorithm saves a bitrate of 0.89%, 0.84%, and 0.90% on average for the Y, Cb, and Cr components, respectively. In addition, when compared with some other existing works, our algorithm showed superior performance in bitrate savings.
first_indexed 2024-03-09T03:52:51Z
format Article
id doaj.art-cbfe1c154be242d899d7c907a5acac1e
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T03:52:51Z
publishDate 2022-08-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-cbfe1c154be242d899d7c907a5acac1e2023-12-03T14:25:25ZengMDPI AGSensors1424-82202022-08-012216597710.3390/s22165977Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear PredictionDan Luo0Shuhua Xiong1Chao Ren2Raymond Edward Sheriff3Xiaohai He4College of Electronics and Information Engineering, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, ChinaCollege of Electronics and Information Engineering, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, ChinaCollege of Electronics and Information Engineering, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, ChinaDepartment of Computer Science, Edge Hill University, Ormskirk L39 4QP, UKCollege of Electronics and Information Engineering, Sichuan University, No. 24 South Section 1, Yihuan Road, Chengdu 610065, ChinaThe new generation video coding standard Versatile Video Coding (VVC) has adopted many novel technologies to improve compression performance, and consequently, remarkable results have been achieved. In practical applications, less data, in terms of bitrate, would reduce the burden of the sensors and improve their performance. Hence, to further enhance the intra compression performance of VVC, we propose a fusion-based intra prediction algorithm in this paper. Specifically, to better predict areas with similar texture information, we propose a fusion-based adaptive template matching method, which directly takes the error between reference and objective templates into account. Furthermore, to better utilize the correlation between reference pixels and the pixels to be predicted, we propose a fusion-based linear prediction method, which can compensate for the deficiency of single linear prediction. We implemented our algorithm on top of the VVC Test Model (VTM) 9.1. When compared with the VVC, our proposed fusion-based algorithm saves a bitrate of 0.89%, 0.84%, and 0.90% on average for the Y, Cb, and Cr components, respectively. In addition, when compared with some other existing works, our algorithm showed superior performance in bitrate savings.https://www.mdpi.com/1424-8220/22/16/5977Versatile Video Codingintra predictiontemplate matchinglinear prediction
spellingShingle Dan Luo
Shuhua Xiong
Chao Ren
Raymond Edward Sheriff
Xiaohai He
Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
Sensors
Versatile Video Coding
intra prediction
template matching
linear prediction
title Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
title_full Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
title_fullStr Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
title_full_unstemmed Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
title_short Fusion-Based Versatile Video Coding Intra Prediction Algorithm with Template Matching and Linear Prediction
title_sort fusion based versatile video coding intra prediction algorithm with template matching and linear prediction
topic Versatile Video Coding
intra prediction
template matching
linear prediction
url https://www.mdpi.com/1424-8220/22/16/5977
work_keys_str_mv AT danluo fusionbasedversatilevideocodingintrapredictionalgorithmwithtemplatematchingandlinearprediction
AT shuhuaxiong fusionbasedversatilevideocodingintrapredictionalgorithmwithtemplatematchingandlinearprediction
AT chaoren fusionbasedversatilevideocodingintrapredictionalgorithmwithtemplatematchingandlinearprediction
AT raymondedwardsheriff fusionbasedversatilevideocodingintrapredictionalgorithmwithtemplatematchingandlinearprediction
AT xiaohaihe fusionbasedversatilevideocodingintrapredictionalgorithmwithtemplatematchingandlinearprediction