A method of face texture fusion based on visibility weight

In the reconstruction process from 2D images to 3D face models, texture completion still suffers from pixel blurring and color inconsistency when face images are under different perspectives. In this paper, we propose a method based on visibility weights for face texture fusion. Meanwhile, for the c...

Full description

Bibliographic Details
Main Authors: LIU Yang, FAN Yangyu, MA Haoyue, LYU Guoyun, LIU Shiya
Format: Article
Language:zho
Published: EDP Sciences 2023-04-01
Series:Xibei Gongye Daxue Xuebao
Subjects:
Online Access:https://www.jnwpu.org/articles/jnwpu/full_html/2023/02/jnwpu2023412p370/jnwpu2023412p370.html
_version_ 1797415084600852480
author LIU Yang
FAN Yangyu
MA Haoyue
LYU Guoyun
LIU Shiya
author_facet LIU Yang
FAN Yangyu
MA Haoyue
LYU Guoyun
LIU Shiya
author_sort LIU Yang
collection DOAJ
description In the reconstruction process from 2D images to 3D face models, texture completion still suffers from pixel blurring and color inconsistency when face images are under different perspectives. In this paper, we propose a method based on visibility weights for face texture fusion. Meanwhile, for the complex geometric structure of the ear region where the traditional texture mapping algorithm is inapplicable, a skin color probability method with Gaussian model is used for pixel completion, and jointly optimized with the texture fusion band. Finally, we generate a complete and high-fidelity face texture model. The simulation experiment shows that the novel face texture fusion and completion method generates the perfect texture under multiple viewpoints. Our face texture model outperforms state-of-the-art techniques under the same rendering conditions.
first_indexed 2024-03-09T05:42:56Z
format Article
id doaj.art-30db2b392ace45ef9ce901c9867cccc4
institution Directory Open Access Journal
issn 1000-2758
2609-7125
language zho
last_indexed 2024-03-09T05:42:56Z
publishDate 2023-04-01
publisher EDP Sciences
record_format Article
series Xibei Gongye Daxue Xuebao
spelling doaj.art-30db2b392ace45ef9ce901c9867cccc42023-12-03T12:23:26ZzhoEDP SciencesXibei Gongye Daxue Xuebao1000-27582609-71252023-04-0141237037810.1051/jnwpu/20234120370jnwpu2023412p370A method of face texture fusion based on visibility weightLIU Yang0FAN Yangyu1MA Haoyue2LYU Guoyun3LIU Shiya4School of Electronics and Information, Northwestern Polytechnical UniversitySchool of Electronics and Information, Northwestern Polytechnical UniversitySchool of Electronics and Information, Northwestern Polytechnical UniversitySchool of Electronics and Information, Northwestern Polytechnical UniversityContent Production Center of Virtual RealityIn the reconstruction process from 2D images to 3D face models, texture completion still suffers from pixel blurring and color inconsistency when face images are under different perspectives. In this paper, we propose a method based on visibility weights for face texture fusion. Meanwhile, for the complex geometric structure of the ear region where the traditional texture mapping algorithm is inapplicable, a skin color probability method with Gaussian model is used for pixel completion, and jointly optimized with the texture fusion band. Finally, we generate a complete and high-fidelity face texture model. The simulation experiment shows that the novel face texture fusion and completion method generates the perfect texture under multiple viewpoints. Our face texture model outperforms state-of-the-art techniques under the same rendering conditions.https://www.jnwpu.org/articles/jnwpu/full_html/2023/02/jnwpu2023412p370/jnwpu2023412p370.html纹理融合纹理补全人脸重建纹理映射
spellingShingle LIU Yang
FAN Yangyu
MA Haoyue
LYU Guoyun
LIU Shiya
A method of face texture fusion based on visibility weight
Xibei Gongye Daxue Xuebao
纹理融合
纹理补全
人脸重建
纹理映射
title A method of face texture fusion based on visibility weight
title_full A method of face texture fusion based on visibility weight
title_fullStr A method of face texture fusion based on visibility weight
title_full_unstemmed A method of face texture fusion based on visibility weight
title_short A method of face texture fusion based on visibility weight
title_sort method of face texture fusion based on visibility weight
topic 纹理融合
纹理补全
人脸重建
纹理映射
url https://www.jnwpu.org/articles/jnwpu/full_html/2023/02/jnwpu2023412p370/jnwpu2023412p370.html
work_keys_str_mv AT liuyang amethodoffacetexturefusionbasedonvisibilityweight
AT fanyangyu amethodoffacetexturefusionbasedonvisibilityweight
AT mahaoyue amethodoffacetexturefusionbasedonvisibilityweight
AT lyuguoyun amethodoffacetexturefusionbasedonvisibilityweight
AT liushiya amethodoffacetexturefusionbasedonvisibilityweight
AT liuyang methodoffacetexturefusionbasedonvisibilityweight
AT fanyangyu methodoffacetexturefusionbasedonvisibilityweight
AT mahaoyue methodoffacetexturefusionbasedonvisibilityweight
AT lyuguoyun methodoffacetexturefusionbasedonvisibilityweight
AT liushiya methodoffacetexturefusionbasedonvisibilityweight