Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks
In this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT)...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9404176/ |
_version_ | 1818563042995077120 |
---|---|
author | Zhanyuan Qi Cheolkon Jung Binghua Xie |
author_facet | Zhanyuan Qi Cheolkon Jung Binghua Xie |
author_sort | Zhanyuan Qi |
collection | DOAJ |
description | In this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT) on the input image. For low frequency subband (LL), we use a simple and effective shallow CNN to restore the low frequency component, while for high frequency subbands (LH, HL, and HH) we utilize multi-kernel convolution to capture multiscale features and restore sparse high frequency components. Then, we conduct mixed convolution of dilated convolution and standard convolution to expand the receptive field while introducing channel and spatial attentions to adjust the proportion of different subbands and spatial coordinates. Various experiments on Classic5 and LIVE1 datasets show that the proposed method successfully recovers sharp edges and clear textures in highly compressed images while removing compression artifacts such as blocking and banding. Moreover, the proposed method achieves comparable state-of-the-art performance on compression artifact removal in terms of both visual quality and quantitative measurements. |
first_indexed | 2024-12-14T01:11:41Z |
format | Article |
id | doaj.art-06891225f4f4494ea1580c087882eb92 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-14T01:11:41Z |
publishDate | 2021-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-06891225f4f4494ea1580c087882eb922022-12-21T23:22:43ZengIEEEIEEE Access2169-35362021-01-019625936260110.1109/ACCESS.2021.30732029404176Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural NetworksZhanyuan Qi0Cheolkon Jung1https://orcid.org/0000-0003-0299-7206Binghua Xie2School of Electronic Engineering, Xidian University, Xian, ChinaSchool of Electronic Engineering, Xidian University, Xian, ChinaSchool of Electronic Engineering, Xidian University, Xian, ChinaIn this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT) on the input image. For low frequency subband (LL), we use a simple and effective shallow CNN to restore the low frequency component, while for high frequency subbands (LH, HL, and HH) we utilize multi-kernel convolution to capture multiscale features and restore sparse high frequency components. Then, we conduct mixed convolution of dilated convolution and standard convolution to expand the receptive field while introducing channel and spatial attentions to adjust the proportion of different subbands and spatial coordinates. Various experiments on Classic5 and LIVE1 datasets show that the proposed method successfully recovers sharp edges and clear textures in highly compressed images while removing compression artifacts such as blocking and banding. Moreover, the proposed method achieves comparable state-of-the-art performance on compression artifact removal in terms of both visual quality and quantitative measurements.https://ieeexplore.ieee.org/document/9404176/Image deblockingcompressionconvolutional neural networkwaveletsubband adaptive |
spellingShingle | Zhanyuan Qi Cheolkon Jung Binghua Xie Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks IEEE Access Image deblocking compression convolutional neural network wavelet subband adaptive |
title | Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks |
title_full | Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks |
title_fullStr | Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks |
title_full_unstemmed | Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks |
title_short | Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks |
title_sort | subband adaptive image deblocking using wavelet based convolutional neural networks |
topic | Image deblocking compression convolutional neural network wavelet subband adaptive |
url | https://ieeexplore.ieee.org/document/9404176/ |
work_keys_str_mv | AT zhanyuanqi subbandadaptiveimagedeblockingusingwaveletbasedconvolutionalneuralnetworks AT cheolkonjung subbandadaptiveimagedeblockingusingwaveletbasedconvolutionalneuralnetworks AT binghuaxie subbandadaptiveimagedeblockingusingwaveletbasedconvolutionalneuralnetworks |