Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm

Abstract Virtual fitting can bring fast and convenient fitting experience for people. The two core problems of virtual fitting system are human–computer interaction and clothing simulation. Interaction is an important factor in determining the fitting experience. The previous virtual fitting product...

Full description

Bibliographic Details
Main Authors: Ying Wu, Hongbing Liu, Pengzhen Lu, Lihua Zhang, Fangjian Yuan
Format: Article
Language:English
Published: Nature Portfolio 2022-11-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-022-21734-y
_version_ 1811328497211146240
author Ying Wu
Hongbing Liu
Pengzhen Lu
Lihua Zhang
Fangjian Yuan
author_facet Ying Wu
Hongbing Liu
Pengzhen Lu
Lihua Zhang
Fangjian Yuan
author_sort Ying Wu
collection DOAJ
description Abstract Virtual fitting can bring fast and convenient fitting experience for people. The two core problems of virtual fitting system are human–computer interaction and clothing simulation. Interaction is an important factor in determining the fitting experience. The previous virtual fitting products usually use the mouse and keyboard interaction, and users rarely have a good sense of substitution and interaction. While, the method of using multiple cameras to take user images from different angles and then carry out posture recognition has the defect of low recognition accuracy. In view of clothing simulation and human–computer interaction of virtual fitting system, in order to achieve better customer immersion experience, this paper implemented a real-time interactive virtual fitting system based on Microsoft Kinect motion sensing device, and proposed a gesture determination algorithm based on finger recognition and an image transfer algorithm based on skeleton information matching. Using OpenNI development library and multi-threading technology, we have developed a motion-sensing capture module and a complete real-time virtual fitting system, and the system test results show that it has a good user experience.
first_indexed 2024-04-13T15:27:15Z
format Article
id doaj.art-eaf7b5e0ddb74dab872e4cc43c3aa0f1
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-04-13T15:27:15Z
publishDate 2022-11-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-eaf7b5e0ddb74dab872e4cc43c3aa0f12022-12-22T02:41:29ZengNature PortfolioScientific Reports2045-23222022-11-0112111310.1038/s41598-022-21734-yDesign and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithmYing Wu0Hongbing Liu1Pengzhen Lu2Lihua Zhang3Fangjian Yuan4Jiaxing Nanhu UniversityJiaxing Nanhu UniversityZhejiang University of TechnologyJiaxing Nanhu UniversityHangzhou Dianzi UniversityAbstract Virtual fitting can bring fast and convenient fitting experience for people. The two core problems of virtual fitting system are human–computer interaction and clothing simulation. Interaction is an important factor in determining the fitting experience. The previous virtual fitting products usually use the mouse and keyboard interaction, and users rarely have a good sense of substitution and interaction. While, the method of using multiple cameras to take user images from different angles and then carry out posture recognition has the defect of low recognition accuracy. In view of clothing simulation and human–computer interaction of virtual fitting system, in order to achieve better customer immersion experience, this paper implemented a real-time interactive virtual fitting system based on Microsoft Kinect motion sensing device, and proposed a gesture determination algorithm based on finger recognition and an image transfer algorithm based on skeleton information matching. Using OpenNI development library and multi-threading technology, we have developed a motion-sensing capture module and a complete real-time virtual fitting system, and the system test results show that it has a good user experience.https://doi.org/10.1038/s41598-022-21734-y
spellingShingle Ying Wu
Hongbing Liu
Pengzhen Lu
Lihua Zhang
Fangjian Yuan
Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
Scientific Reports
title Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
title_full Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
title_fullStr Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
title_full_unstemmed Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
title_short Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
title_sort design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm
url https://doi.org/10.1038/s41598-022-21734-y
work_keys_str_mv AT yingwu designandimplementationofvirtualfittingsystembasedongesturerecognitionandclothingtransferalgorithm
AT hongbingliu designandimplementationofvirtualfittingsystembasedongesturerecognitionandclothingtransferalgorithm
AT pengzhenlu designandimplementationofvirtualfittingsystembasedongesturerecognitionandclothingtransferalgorithm
AT lihuazhang designandimplementationofvirtualfittingsystembasedongesturerecognitionandclothingtransferalgorithm
AT fangjianyuan designandimplementationofvirtualfittingsystembasedongesturerecognitionandclothingtransferalgorithm