Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks

In this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT)...

Full description

Bibliographic Details
Main Authors: Zhanyuan Qi, Cheolkon Jung, Binghua Xie
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9404176/
_version_ 1818563042995077120
author Zhanyuan Qi
Cheolkon Jung
Binghua Xie
author_facet Zhanyuan Qi
Cheolkon Jung
Binghua Xie
author_sort Zhanyuan Qi
collection DOAJ
description In this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT) on the input image. For low frequency subband (LL), we use a simple and effective shallow CNN to restore the low frequency component, while for high frequency subbands (LH, HL, and HH) we utilize multi-kernel convolution to capture multiscale features and restore sparse high frequency components. Then, we conduct mixed convolution of dilated convolution and standard convolution to expand the receptive field while introducing channel and spatial attentions to adjust the proportion of different subbands and spatial coordinates. Various experiments on Classic5 and LIVE1 datasets show that the proposed method successfully recovers sharp edges and clear textures in highly compressed images while removing compression artifacts such as blocking and banding. Moreover, the proposed method achieves comparable state-of-the-art performance on compression artifact removal in terms of both visual quality and quantitative measurements.
first_indexed 2024-12-14T01:11:41Z
format Article
id doaj.art-06891225f4f4494ea1580c087882eb92
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-14T01:11:41Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-06891225f4f4494ea1580c087882eb922022-12-21T23:22:43ZengIEEEIEEE Access2169-35362021-01-019625936260110.1109/ACCESS.2021.30732029404176Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural NetworksZhanyuan Qi0Cheolkon Jung1https://orcid.org/0000-0003-0299-7206Binghua Xie2School of Electronic Engineering, Xidian University, Xian, ChinaSchool of Electronic Engineering, Xidian University, Xian, ChinaSchool of Electronic Engineering, Xidian University, Xian, ChinaIn this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT) on the input image. For low frequency subband (LL), we use a simple and effective shallow CNN to restore the low frequency component, while for high frequency subbands (LH, HL, and HH) we utilize multi-kernel convolution to capture multiscale features and restore sparse high frequency components. Then, we conduct mixed convolution of dilated convolution and standard convolution to expand the receptive field while introducing channel and spatial attentions to adjust the proportion of different subbands and spatial coordinates. Various experiments on Classic5 and LIVE1 datasets show that the proposed method successfully recovers sharp edges and clear textures in highly compressed images while removing compression artifacts such as blocking and banding. Moreover, the proposed method achieves comparable state-of-the-art performance on compression artifact removal in terms of both visual quality and quantitative measurements.https://ieeexplore.ieee.org/document/9404176/Image deblockingcompressionconvolutional neural networkwaveletsubband adaptive
spellingShingle Zhanyuan Qi
Cheolkon Jung
Binghua Xie
Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
IEEE Access
Image deblocking
compression
convolutional neural network
wavelet
subband adaptive
title Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
title_full Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
title_fullStr Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
title_full_unstemmed Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
title_short Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
title_sort subband adaptive image deblocking using wavelet based convolutional neural networks
topic Image deblocking
compression
convolutional neural network
wavelet
subband adaptive
url https://ieeexplore.ieee.org/document/9404176/
work_keys_str_mv AT zhanyuanqi subbandadaptiveimagedeblockingusingwaveletbasedconvolutionalneuralnetworks
AT cheolkonjung subbandadaptiveimagedeblockingusingwaveletbasedconvolutionalneuralnetworks
AT binghuaxie subbandadaptiveimagedeblockingusingwaveletbasedconvolutionalneuralnetworks