Image-based clothes changing system

Abstract Current image-editing tools do not match up to the demands of personalized image manipulation, one application of which is changing clothes in usercaptured images. Previous work can change single color clothes using parametric human warping methods. In this paper, we propose an image-based...

Full description

Bibliographic Details
Main Authors: Zhao-Heng Zheng, Hao-Tian Zhang, Fang-Lue Zhang, Tai-Jiang Mu
Format: Article
Language:English
Published: SpringerOpen 2017-05-01
Series:Computational Visual Media
Subjects:
Online Access:http://link.springer.com/article/10.1007/s41095-017-0084-6
_version_ 1818973941983608832
author Zhao-Heng Zheng
Hao-Tian Zhang
Fang-Lue Zhang
Tai-Jiang Mu
author_facet Zhao-Heng Zheng
Hao-Tian Zhang
Fang-Lue Zhang
Tai-Jiang Mu
author_sort Zhao-Heng Zheng
collection DOAJ
description Abstract Current image-editing tools do not match up to the demands of personalized image manipulation, one application of which is changing clothes in usercaptured images. Previous work can change single color clothes using parametric human warping methods. In this paper, we propose an image-based clothes changing system, exploiting body factor extraction and content-aware image warping. Image segmentation and mask generation are first applied to the user input. Afterwards, we determine joint positions via a neural network. Then, body shape matching is performed and the shape of the model is warped to the user’s shape. Finally, head swapping is performed to produce realistic virtual results. We also provide a supervision and labeling tool for refinement and further assistance when creating a dataset.
first_indexed 2024-12-20T15:32:10Z
format Article
id doaj.art-b9ca336d10e548a1a924e3ac37bbdc59
institution Directory Open Access Journal
issn 2096-0433
2096-0662
language English
last_indexed 2024-12-20T15:32:10Z
publishDate 2017-05-01
publisher SpringerOpen
record_format Article
series Computational Visual Media
spelling doaj.art-b9ca336d10e548a1a924e3ac37bbdc592022-12-21T19:35:35ZengSpringerOpenComputational Visual Media2096-04332096-06622017-05-013433734710.1007/s41095-017-0084-6Image-based clothes changing systemZhao-Heng Zheng0Hao-Tian Zhang1Fang-Lue Zhang2Tai-Jiang Mu3Computer Science and Engineering, University of MichiganComputer Science Department, Stanford UniversitySchool of Engineering and Computer Science, Victoria University of WellingtonTNList, Tsinghua UniversityAbstract Current image-editing tools do not match up to the demands of personalized image manipulation, one application of which is changing clothes in usercaptured images. Previous work can change single color clothes using parametric human warping methods. In this paper, we propose an image-based clothes changing system, exploiting body factor extraction and content-aware image warping. Image segmentation and mask generation are first applied to the user input. Afterwards, we determine joint positions via a neural network. Then, body shape matching is performed and the shape of the model is warped to the user’s shape. Finally, head swapping is performed to produce realistic virtual results. We also provide a supervision and labeling tool for refinement and further assistance when creating a dataset.http://link.springer.com/article/10.1007/s41095-017-0084-6clothing try-onimage warpinghuman segmentation
spellingShingle Zhao-Heng Zheng
Hao-Tian Zhang
Fang-Lue Zhang
Tai-Jiang Mu
Image-based clothes changing system
Computational Visual Media
clothing try-on
image warping
human segmentation
title Image-based clothes changing system
title_full Image-based clothes changing system
title_fullStr Image-based clothes changing system
title_full_unstemmed Image-based clothes changing system
title_short Image-based clothes changing system
title_sort image based clothes changing system
topic clothing try-on
image warping
human segmentation
url http://link.springer.com/article/10.1007/s41095-017-0084-6
work_keys_str_mv AT zhaohengzheng imagebasedclotheschangingsystem
AT haotianzhang imagebasedclotheschangingsystem
AT fangluezhang imagebasedclotheschangingsystem
AT taijiangmu imagebasedclotheschangingsystem