FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator
Since generative adversarial network (GAN) was first proposed, the processing of face images, especially the research of facial attribute editing, has attracted much interest. It not only can alleviate the problems associated with data deficiency, but also has great applications in the field of ente...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9055004/ |
_version_ | 1818428084206960640 |
---|---|
author | Xin Ning Shaohui Xu Weijun Li Shuai Nie |
author_facet | Xin Ning Shaohui Xu Weijun Li Shuai Nie |
author_sort | Xin Ning |
collection | DOAJ |
description | Since generative adversarial network (GAN) was first proposed, the processing of face images, especially the research of facial attribute editing, has attracted much interest. It not only can alleviate the problems associated with data deficiency, but also has great applications in the field of entertainment. However, existing approaches have limited scalability in the processing of newly-added face attributes, and the quality of generated images is poor. To solve these problems, FEGAN is proposed in this paper to achieve the accurate editing of multi-attribute faces by modifying feature vectors in the latent space. Firstly, a trained generator is used, which greatly reduces the training difficulty of GANs, and the inverse of the generator is used to establish the unique correspondence between the input image and the latent code. Secondly, a linear guide is applied to the latent code, and thus the same distribution as the target image in the latent space is assured. Finally, a generator is used to generate a face image from the guided latent code. The proposed method is utilized for a large number of attribute editing experiments, and the results show that FEGAN can flexibly perform accurate attribute editing while guaranteeing that other areas are not changed. Both qualitative and quantitative results demonstrate its advantages over existing methods. |
first_indexed | 2024-12-14T14:56:00Z |
format | Article |
id | doaj.art-7ffb4f773f6247da8223fc513739eb57 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-14T14:56:00Z |
publishDate | 2020-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-7ffb4f773f6247da8223fc513739eb572022-12-21T22:56:58ZengIEEEIEEE Access2169-35362020-01-018653406535010.1109/ACCESS.2020.29850869055004FEGAN: Flexible and Efficient Face Editing With Pre-Trained GeneratorXin Ning0https://orcid.org/0000-0001-7897-1673Shaohui Xu1https://orcid.org/0000-0002-9490-7644Weijun Li2https://orcid.org/0000-0001-9668-2883Shuai Nie3https://orcid.org/0000-0003-3141-1972Institute of Semiconductors, Chinese Academy of Sciences, Beijing, ChinaBeijing Wave Security Technology Company, Ltd., Beijing, ChinaInstitute of Semiconductors, Chinese Academy of Sciences, Beijing, ChinaBeijing Wave Security Technology Company, Ltd., Beijing, ChinaSince generative adversarial network (GAN) was first proposed, the processing of face images, especially the research of facial attribute editing, has attracted much interest. It not only can alleviate the problems associated with data deficiency, but also has great applications in the field of entertainment. However, existing approaches have limited scalability in the processing of newly-added face attributes, and the quality of generated images is poor. To solve these problems, FEGAN is proposed in this paper to achieve the accurate editing of multi-attribute faces by modifying feature vectors in the latent space. Firstly, a trained generator is used, which greatly reduces the training difficulty of GANs, and the inverse of the generator is used to establish the unique correspondence between the input image and the latent code. Secondly, a linear guide is applied to the latent code, and thus the same distribution as the target image in the latent space is assured. Finally, a generator is used to generate a face image from the guided latent code. The proposed method is utilized for a large number of attribute editing experiments, and the results show that FEGAN can flexibly perform accurate attribute editing while guaranteeing that other areas are not changed. Both qualitative and quantitative results demonstrate its advantages over existing methods.https://ieeexplore.ieee.org/document/9055004/GenerationGANsface attributeface editinglatent code |
spellingShingle | Xin Ning Shaohui Xu Weijun Li Shuai Nie FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator IEEE Access Generation GANs face attribute face editing latent code |
title | FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator |
title_full | FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator |
title_fullStr | FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator |
title_full_unstemmed | FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator |
title_short | FEGAN: Flexible and Efficient Face Editing With Pre-Trained Generator |
title_sort | fegan flexible and efficient face editing with pre trained generator |
topic | Generation GANs face attribute face editing latent code |
url | https://ieeexplore.ieee.org/document/9055004/ |
work_keys_str_mv | AT xinning feganflexibleandefficientfaceeditingwithpretrainedgenerator AT shaohuixu feganflexibleandefficientfaceeditingwithpretrainedgenerator AT weijunli feganflexibleandefficientfaceeditingwithpretrainedgenerator AT shuainie feganflexibleandefficientfaceeditingwithpretrainedgenerator |