From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes

Summary: We propose a two-stage deep residual attention generative adversarial network (TSDRA-GAN) for inpainting iris textures obscured by eyelids. This two-stage generation approach ensures that the semantic and texture information of the generated images is preserved. In the second stage of the f...

Full description

Bibliographic Details
Main Authors: Ying Chen, Yugang Zeng, Liang Xu, Shubin Guo, Ali Asghar Heidari, Huiling Chen, Yudong Zhang
Format: Article
Language:English
Published: Elsevier 2023-07-01
Series:iScience
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2589004223012464
_version_ 1797774563768008704
author Ying Chen
Yugang Zeng
Liang Xu
Shubin Guo
Ali Asghar Heidari
Huiling Chen
Yudong Zhang
author_facet Ying Chen
Yugang Zeng
Liang Xu
Shubin Guo
Ali Asghar Heidari
Huiling Chen
Yudong Zhang
author_sort Ying Chen
collection DOAJ
description Summary: We propose a two-stage deep residual attention generative adversarial network (TSDRA-GAN) for inpainting iris textures obscured by eyelids. This two-stage generation approach ensures that the semantic and texture information of the generated images is preserved. In the second stage of the fine network, a modified residual block (MRB) is used to further extract features and mitigate the performance degradation caused by the deepening of the network, thus following the concept of using a residual structure as a component of the encoder. In addition, for the skip connection part of this phase, we propose a dual-attention computing connection (DACC) to computationally fuse the features of the encoder and decoder in both directions to achieve more effective information fusion for iris inpainting tasks. Under completely fair and equal experimental conditions, it is shown that the method presented in this paper can effectively restore original iris images and improve recognition accuracy.
first_indexed 2024-03-12T22:22:00Z
format Article
id doaj.art-a271b260ef3049209fee2fc5dbb537ce
institution Directory Open Access Journal
issn 2589-0042
language English
last_indexed 2024-03-12T22:22:00Z
publishDate 2023-07-01
publisher Elsevier
record_format Article
series iScience
spelling doaj.art-a271b260ef3049209fee2fc5dbb537ce2023-07-23T04:55:48ZengElsevieriScience2589-00422023-07-01267107169From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashesYing Chen0Yugang Zeng1Liang Xu2Shubin Guo3Ali Asghar Heidari4Huiling Chen5Yudong Zhang6School of Software, Nanchang Hangkong University, Nanchang, Jiangxi 330063, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, Jiangxi 330063, China; Corresponding authorSchool of Software, Nanchang Hangkong University, Nanchang, Jiangxi 330063, ChinaSchool of Software, Nanchang Hangkong University, Nanchang, Jiangxi 330063, ChinaSchool of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran, IranKey Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou 325035, PR China; Corresponding authorSchool of Computing and Mathematical Sciences, University of Leicester, LE1 7RH Leicester, UK; Corresponding authorSummary: We propose a two-stage deep residual attention generative adversarial network (TSDRA-GAN) for inpainting iris textures obscured by eyelids. This two-stage generation approach ensures that the semantic and texture information of the generated images is preserved. In the second stage of the fine network, a modified residual block (MRB) is used to further extract features and mitigate the performance degradation caused by the deepening of the network, thus following the concept of using a residual structure as a component of the encoder. In addition, for the skip connection part of this phase, we propose a dual-attention computing connection (DACC) to computationally fuse the features of the encoder and decoder in both directions to achieve more effective information fusion for iris inpainting tasks. Under completely fair and equal experimental conditions, it is shown that the method presented in this paper can effectively restore original iris images and improve recognition accuracy.http://www.sciencedirect.com/science/article/pii/S2589004223012464Health sciencesMedicineOptometry
spellingShingle Ying Chen
Yugang Zeng
Liang Xu
Shubin Guo
Ali Asghar Heidari
Huiling Chen
Yudong Zhang
From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
iScience
Health sciences
Medicine
Optometry
title From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
title_full From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
title_fullStr From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
title_full_unstemmed From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
title_short From coarse to fine: Two-stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
title_sort from coarse to fine two stage deep residual attention generative adversarial network for repair of iris textures obscured by eyelids and eyelashes
topic Health sciences
Medicine
Optometry
url http://www.sciencedirect.com/science/article/pii/S2589004223012464
work_keys_str_mv AT yingchen fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes
AT yugangzeng fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes
AT liangxu fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes
AT shubinguo fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes
AT aliasgharheidari fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes
AT huilingchen fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes
AT yudongzhang fromcoarsetofinetwostagedeepresidualattentiongenerativeadversarialnetworkforrepairofiristexturesobscuredbyeyelidsandeyelashes