Face deblurring based on regularized structure and enhanced texture information

Abstract Image deblurring is an essential problem in computer vision. Due to highly structured and special facial components (e.g. eyes), most general image deblurring methods and face deblurring methods failed to yield more explicit structure and facial details, resulting in too smooth, uncoordinat...

Full description

Bibliographic Details
Main Authors: Canghong Shi, Xian Zhang, Xiaojie Li, Imran Mumtaz, Jiancheng Lv
Format: Article
Language:English
Published: Springer 2023-10-01
Series:Complex & Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1007/s40747-023-01234-w
_version_ 1797233167788146688
author Canghong Shi
Xian Zhang
Xiaojie Li
Imran Mumtaz
Jiancheng Lv
author_facet Canghong Shi
Xian Zhang
Xiaojie Li
Imran Mumtaz
Jiancheng Lv
author_sort Canghong Shi
collection DOAJ
description Abstract Image deblurring is an essential problem in computer vision. Due to highly structured and special facial components (e.g. eyes), most general image deblurring methods and face deblurring methods failed to yield more explicit structure and facial details, resulting in too smooth, uncoordinated and distorted face structure. Considering the unique face texture and sufficient facial details, we present an effective face deblurring network by exploiting more regularized structure and enhanced texture information (RSETNet). We first incorporate the face parsing network with fine-tuning to obtain more accurate face structure, and we present the feature adaptive denormalization (FAD) to regularize the facial structure as a condition of auxiliary to generate more harmonious and undistorted face structure. Meanwhile, to improve the generated facial texture information, we propose a new Laplace depth-wise separable convolution (LDConv) and multi-patch discriminator. Compared with existing methods, our face deblurring method could restore face structure more accurately and with more facial details. Experiments on two public face datasets have demonstrated the effectiveness of our proposed methods in terms of qualitative and quantitative indicators.
first_indexed 2024-04-24T16:11:52Z
format Article
id doaj.art-2e2a0e4383b546409e581e3f13f15079
institution Directory Open Access Journal
issn 2199-4536
2198-6053
language English
last_indexed 2024-04-24T16:11:52Z
publishDate 2023-10-01
publisher Springer
record_format Article
series Complex & Intelligent Systems
spelling doaj.art-2e2a0e4383b546409e581e3f13f150792024-03-31T11:39:25ZengSpringerComplex & Intelligent Systems2199-45362198-60532023-10-011021769178610.1007/s40747-023-01234-wFace deblurring based on regularized structure and enhanced texture informationCanghong Shi0Xian Zhang1Xiaojie Li2Imran Mumtaz3Jiancheng Lv4Xihua UniversitySchool of Computer Science, Chengdu University of Information TechnologySchool of Computer Science, Chengdu University of Information TechnologyUniversity of AgricultureSichuan UniversityAbstract Image deblurring is an essential problem in computer vision. Due to highly structured and special facial components (e.g. eyes), most general image deblurring methods and face deblurring methods failed to yield more explicit structure and facial details, resulting in too smooth, uncoordinated and distorted face structure. Considering the unique face texture and sufficient facial details, we present an effective face deblurring network by exploiting more regularized structure and enhanced texture information (RSETNet). We first incorporate the face parsing network with fine-tuning to obtain more accurate face structure, and we present the feature adaptive denormalization (FAD) to regularize the facial structure as a condition of auxiliary to generate more harmonious and undistorted face structure. Meanwhile, to improve the generated facial texture information, we propose a new Laplace depth-wise separable convolution (LDConv) and multi-patch discriminator. Compared with existing methods, our face deblurring method could restore face structure more accurately and with more facial details. Experiments on two public face datasets have demonstrated the effectiveness of our proposed methods in terms of qualitative and quantitative indicators.https://doi.org/10.1007/s40747-023-01234-wFace deblurringLaplace depth-wise separable convolutionFacial adaptive denormalizationEnhanced texture information
spellingShingle Canghong Shi
Xian Zhang
Xiaojie Li
Imran Mumtaz
Jiancheng Lv
Face deblurring based on regularized structure and enhanced texture information
Complex & Intelligent Systems
Face deblurring
Laplace depth-wise separable convolution
Facial adaptive denormalization
Enhanced texture information
title Face deblurring based on regularized structure and enhanced texture information
title_full Face deblurring based on regularized structure and enhanced texture information
title_fullStr Face deblurring based on regularized structure and enhanced texture information
title_full_unstemmed Face deblurring based on regularized structure and enhanced texture information
title_short Face deblurring based on regularized structure and enhanced texture information
title_sort face deblurring based on regularized structure and enhanced texture information
topic Face deblurring
Laplace depth-wise separable convolution
Facial adaptive denormalization
Enhanced texture information
url https://doi.org/10.1007/s40747-023-01234-w
work_keys_str_mv AT canghongshi facedeblurringbasedonregularizedstructureandenhancedtextureinformation
AT xianzhang facedeblurringbasedonregularizedstructureandenhancedtextureinformation
AT xiaojieli facedeblurringbasedonregularizedstructureandenhancedtextureinformation
AT imranmumtaz facedeblurringbasedonregularizedstructureandenhancedtextureinformation
AT jianchenglv facedeblurringbasedonregularizedstructureandenhancedtextureinformation