Bipartite graph reasoning GANs for person pose and facial image synthesis
We present a novel bipartite graph reasoning Generative Adversarial Network (BiGraphGAN) for two challenging tasks: person pose and facial image synthesis. The proposed graph generator consists of two novel blocks that aim to model the pose-to-pose and pose-to-image relations, respectively. Specific...
| Prif Awduron: | , , , |
|---|---|
| Fformat: | Conference item |
| Iaith: | English |
| Cyhoeddwyd: |
Springer
2022
|
| _version_ | 1826311592424243200 |
|---|---|
| author | Tang, H Shao, L Torr, PHS Sebe, N |
| author_facet | Tang, H Shao, L Torr, PHS Sebe, N |
| author_sort | Tang, H |
| collection | OXFORD |
| description | We present a novel bipartite graph reasoning Generative Adversarial Network (BiGraphGAN) for
two challenging tasks: person pose and facial image synthesis. The proposed graph generator consists of two
novel blocks that aim to model the pose-to-pose and
pose-to-image relations, respectively. Specifically, the
proposed bipartite graph reasoning (BGR) block aims
to reason the long-range cross relations between the
source and target pose in a bipartite graph, which mitigates some of the challenges caused by pose deformation. Moreover, we propose a new interaction-andaggregation (IA) block to effectively update and enhance the feature representation capability of both a
person’s shape and appearance in an interactive way.
To further capture the change in pose of each part
more precisely, we propose a novel part-aware bipartite
graph reasoning (PBGR) block to decompose the task
of reasoning the global structure transformation with
a bipartite graph into learning different local transformations for different semantic body/face parts. Experiments on two challenging generation tasks with three
public datasets demonstrate the effectiveness of the proposed methods in terms of objective quantitative scores
and subjective visual realness. The source code and
trained models are available at https://github.com/
Ha0Tang/BiGraphGAN. |
| first_indexed | 2024-03-07T08:12:03Z |
| format | Conference item |
| id | oxford-uuid:09815d4f-8b1a-4f29-96dc-ad5c1a90b13f |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T08:12:03Z |
| publishDate | 2022 |
| publisher | Springer |
| record_format | dspace |
| spelling | oxford-uuid:09815d4f-8b1a-4f29-96dc-ad5c1a90b13f2023-12-08T08:26:29ZBipartite graph reasoning GANs for person pose and facial image synthesisConference itemhttp://purl.org/coar/resource_type/c_5794uuid:09815d4f-8b1a-4f29-96dc-ad5c1a90b13fEnglishSymplectic ElementsSpringer2022Tang, HShao, LTorr, PHSSebe, NWe present a novel bipartite graph reasoning Generative Adversarial Network (BiGraphGAN) for two challenging tasks: person pose and facial image synthesis. The proposed graph generator consists of two novel blocks that aim to model the pose-to-pose and pose-to-image relations, respectively. Specifically, the proposed bipartite graph reasoning (BGR) block aims to reason the long-range cross relations between the source and target pose in a bipartite graph, which mitigates some of the challenges caused by pose deformation. Moreover, we propose a new interaction-andaggregation (IA) block to effectively update and enhance the feature representation capability of both a person’s shape and appearance in an interactive way. To further capture the change in pose of each part more precisely, we propose a novel part-aware bipartite graph reasoning (PBGR) block to decompose the task of reasoning the global structure transformation with a bipartite graph into learning different local transformations for different semantic body/face parts. Experiments on two challenging generation tasks with three public datasets demonstrate the effectiveness of the proposed methods in terms of objective quantitative scores and subjective visual realness. The source code and trained models are available at https://github.com/ Ha0Tang/BiGraphGAN. |
| spellingShingle | Tang, H Shao, L Torr, PHS Sebe, N Bipartite graph reasoning GANs for person pose and facial image synthesis |
| title | Bipartite graph reasoning GANs for person pose and facial image synthesis |
| title_full | Bipartite graph reasoning GANs for person pose and facial image synthesis |
| title_fullStr | Bipartite graph reasoning GANs for person pose and facial image synthesis |
| title_full_unstemmed | Bipartite graph reasoning GANs for person pose and facial image synthesis |
| title_short | Bipartite graph reasoning GANs for person pose and facial image synthesis |
| title_sort | bipartite graph reasoning gans for person pose and facial image synthesis |
| work_keys_str_mv | AT tangh bipartitegraphreasoninggansforpersonposeandfacialimagesynthesis AT shaol bipartitegraphreasoninggansforpersonposeandfacialimagesynthesis AT torrphs bipartitegraphreasoninggansforpersonposeandfacialimagesynthesis AT seben bipartitegraphreasoninggansforpersonposeandfacialimagesynthesis |