A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications
Online shopping using virtual try-on technology is becoming popular and widely used for digital transformation because of sustainably sourced materials and enhancing customers’ experience. For practical applicability, the process is required for two main factors: (1) accuracy and reliability,...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Brno University of Technology
2023-12-01
|
| Series: | Mendel |
| Subjects: | |
| Online Access: | https://mendel-journal.org/index.php/mendel/article/view/240 |
| _version_ | 1797688522056925184 |
|---|---|
| author | Tran Van Duc Pham Quang Tien Hoang Duc Minh Trieu Nguyen Thi Ngoc Anh Dat Tien Nguyen |
| author_facet | Tran Van Duc Pham Quang Tien Hoang Duc Minh Trieu Nguyen Thi Ngoc Anh Dat Tien Nguyen |
| author_sort | Tran Van Duc |
| collection | DOAJ |
| description |
Online shopping using virtual try-on technology is becoming popular and widely used for digital transformation because of sustainably sourced materials and enhancing customers’ experience. For practical applicability, the process is required for two main factors: (1) accuracy and reliability, and (2) the processing time. To meet the above requirements, we propose a state-of-the-art technique for generating a user’s visualization of model costumes using only a single user portrait and basic anthropometrics. To start, this research would summarize different methods of most virtual try-on clothes approaches, including (1) Interactive simulation between the 3D models, and (2) 2D Photorealistic Generation. In spite of successfully creating the visualization and feasibility, these approaches have to face issues of their efficiency and performance. Furthermore, the complexity of input requirements and the users’ experiments are leading to difficulties in practical application and future scalability. In this regard, our study combines (1) a head-swapping technique using a face alignment model for determining, segmenting, and swapping heads with only a pair of a source and a target image as inputs (2) a photorealistic body reshape pipeline for direct resizing user visualization, and (3) an adaptive skin color models for changing user’s skin, which ensures remaining the face structure and natural. The proposed technique was evaluated quantitatively and qualitatively using three types of datasets which include: (1) VoxCeleb2, (2) Datasets from Viettel collection, and (3) Users Testing to demonstrate its feasibility and efficiency when used in real-world applications
|
| first_indexed | 2024-03-12T01:32:06Z |
| format | Article |
| id | doaj.art-4863ab8f939d4670b2dcb423552a30ef |
| institution | Directory Open Access Journal |
| issn | 1803-3814 2571-3701 |
| language | English |
| last_indexed | 2024-03-12T01:32:06Z |
| publishDate | 2023-12-01 |
| publisher | Brno University of Technology |
| record_format | Article |
| series | Mendel |
| spelling | doaj.art-4863ab8f939d4670b2dcb423552a30ef2023-09-11T20:41:23ZengBrno University of TechnologyMendel1803-38142571-37012023-12-0129210.13164/mendel.2023.2.097A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on ApplicationsTran Van Duc0Pham Quang Tien1Hoang Duc Minh Trieu2Nguyen Thi Ngoc Anh3Dat Tien Nguyen4Viettel High Technology Industries Corporation, Hanoi, VietnamViettel High Technology Industries Corporation, Hanoi, VietnamViettel High Technology Industries Corporation, Hanoi, VietnamVNU University of Engineering and Technology, Hanoi, VietnamViettel High Technology Industries Corporation, Hanoi, Vietnam Online shopping using virtual try-on technology is becoming popular and widely used for digital transformation because of sustainably sourced materials and enhancing customers’ experience. For practical applicability, the process is required for two main factors: (1) accuracy and reliability, and (2) the processing time. To meet the above requirements, we propose a state-of-the-art technique for generating a user’s visualization of model costumes using only a single user portrait and basic anthropometrics. To start, this research would summarize different methods of most virtual try-on clothes approaches, including (1) Interactive simulation between the 3D models, and (2) 2D Photorealistic Generation. In spite of successfully creating the visualization and feasibility, these approaches have to face issues of their efficiency and performance. Furthermore, the complexity of input requirements and the users’ experiments are leading to difficulties in practical application and future scalability. In this regard, our study combines (1) a head-swapping technique using a face alignment model for determining, segmenting, and swapping heads with only a pair of a source and a target image as inputs (2) a photorealistic body reshape pipeline for direct resizing user visualization, and (3) an adaptive skin color models for changing user’s skin, which ensures remaining the face structure and natural. The proposed technique was evaluated quantitatively and qualitatively using three types of datasets which include: (1) VoxCeleb2, (2) Datasets from Viettel collection, and (3) Users Testing to demonstrate its feasibility and efficiency when used in real-world applications https://mendel-journal.org/index.php/mendel/article/view/240Adaptive Skin ColorBody ReshapingHead SwappingPhotorealisticVirtual Try-on |
| spellingShingle | Tran Van Duc Pham Quang Tien Hoang Duc Minh Trieu Nguyen Thi Ngoc Anh Dat Tien Nguyen A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications Mendel Adaptive Skin Color Body Reshaping Head Swapping Photorealistic Virtual Try-on |
| title | A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications |
| title_full | A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications |
| title_fullStr | A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications |
| title_full_unstemmed | A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications |
| title_short | A Hybrid Photorealistic Architecture Based on Generating Facial Features and Body Reshaping for Virtual Try-on Applications |
| title_sort | hybrid photorealistic architecture based on generating facial features and body reshaping for virtual try on applications |
| topic | Adaptive Skin Color Body Reshaping Head Swapping Photorealistic Virtual Try-on |
| url | https://mendel-journal.org/index.php/mendel/article/view/240 |
| work_keys_str_mv | AT tranvanduc ahybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT phamquangtien ahybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT hoangducminhtrieu ahybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT nguyenthingocanh ahybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT dattiennguyen ahybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT tranvanduc hybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT phamquangtien hybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT hoangducminhtrieu hybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT nguyenthingocanh hybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications AT dattiennguyen hybridphotorealisticarchitecturebasedongeneratingfacialfeaturesandbodyreshapingforvirtualtryonapplications |