A GAN-Based Video Intra Coding

Intra prediction is a vital part of the image/video coding framework, which is designed to remove spatial redundancy within a picture. Based on a set of predefined linear combinations, traditional intra prediction cannot cope with coding blocks with irregular textures. To tackle this drawback, in th...

Full description

Bibliographic Details
Main Authors: Guangyu Zhong, Jun Wang, Jiyuan Hu, Fan Liang
Format: Article
Language:English
Published: MDPI AG 2021-01-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/10/2/132
_version_ 1797414136218386432
author Guangyu Zhong
Jun Wang
Jiyuan Hu
Fan Liang
author_facet Guangyu Zhong
Jun Wang
Jiyuan Hu
Fan Liang
author_sort Guangyu Zhong
collection DOAJ
description Intra prediction is a vital part of the image/video coding framework, which is designed to remove spatial redundancy within a picture. Based on a set of predefined linear combinations, traditional intra prediction cannot cope with coding blocks with irregular textures. To tackle this drawback, in this article, we propose a Generative Adversarial Network (GAN)-based intra prediction approach to enhance intra prediction accuracy. Specifically, with the superior non-linear fitting ability, the well-trained generator of GAN acts as a mapping from the adjacent reconstructed signals to the prediction unit, implemented into both encoder and decoder. Simulation results show that for All-Intra configuration, our proposed algorithm achieves, on average, a 1.6% BD-rate cutback for luminance components compared with video coding reference software HM-16.15 and outperforms previous similar works.
first_indexed 2024-03-09T05:27:47Z
format Article
id doaj.art-deac729f7d744d218c1c0b77791c038a
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-09T05:27:47Z
publishDate 2021-01-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-deac729f7d744d218c1c0b77791c038a2023-12-03T12:35:26ZengMDPI AGElectronics2079-92922021-01-0110213210.3390/electronics10020132A GAN-Based Video Intra CodingGuangyu Zhong0Jun Wang1Jiyuan Hu2Fan Liang3School of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou 510006, ChinaSchool of Microelectronics Science and Technology, Sun Yat-Sen University, Zhuhai 519082, ChinaSchool of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou 510006, ChinaSchool of Electronics and Information Technology, Sun Yat-Sen University, Guangzhou 510006, ChinaIntra prediction is a vital part of the image/video coding framework, which is designed to remove spatial redundancy within a picture. Based on a set of predefined linear combinations, traditional intra prediction cannot cope with coding blocks with irregular textures. To tackle this drawback, in this article, we propose a Generative Adversarial Network (GAN)-based intra prediction approach to enhance intra prediction accuracy. Specifically, with the superior non-linear fitting ability, the well-trained generator of GAN acts as a mapping from the adjacent reconstructed signals to the prediction unit, implemented into both encoder and decoder. Simulation results show that for All-Intra configuration, our proposed algorithm achieves, on average, a 1.6% BD-rate cutback for luminance components compared with video coding reference software HM-16.15 and outperforms previous similar works.https://www.mdpi.com/2079-9292/10/2/132intra codinggenerative adversarial networkvideo codinghigh efficiency video coding
spellingShingle Guangyu Zhong
Jun Wang
Jiyuan Hu
Fan Liang
A GAN-Based Video Intra Coding
Electronics
intra coding
generative adversarial network
video coding
high efficiency video coding
title A GAN-Based Video Intra Coding
title_full A GAN-Based Video Intra Coding
title_fullStr A GAN-Based Video Intra Coding
title_full_unstemmed A GAN-Based Video Intra Coding
title_short A GAN-Based Video Intra Coding
title_sort gan based video intra coding
topic intra coding
generative adversarial network
video coding
high efficiency video coding
url https://www.mdpi.com/2079-9292/10/2/132
work_keys_str_mv AT guangyuzhong aganbasedvideointracoding
AT junwang aganbasedvideointracoding
AT jiyuanhu aganbasedvideointracoding
AT fanliang aganbasedvideointracoding
AT guangyuzhong ganbasedvideointracoding
AT junwang ganbasedvideointracoding
AT jiyuanhu ganbasedvideointracoding
AT fanliang ganbasedvideointracoding