Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study
The shape and pose estimation of a human body are essential for human behavior analysis, sports and medical analysis, and virtual reality. Although 2D image data are much easier to acquire than 3D scan data, the estimation accuracy using 2D images is still far below the 3D scanning methodsȁ...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9831448/ |
| _version_ | 1811221792045400064 |
|---|---|
| author | Dongjun Gu Youngsik Yun Thai Thanh Tuan Heejune Ahn |
| author_facet | Dongjun Gu Youngsik Yun Thai Thanh Tuan Heejune Ahn |
| author_sort | Dongjun Gu |
| collection | DOAJ |
| description | The shape and pose estimation of a human body are essential for human behavior analysis, sports and medical analysis, and virtual reality. Although 2D image data are much easier to acquire than 3D scan data, the estimation accuracy using 2D images is still far below the 3D scanning methods’ ones. In this paper, we propose a 2D image-based human body estimation method appropriate for body shape and size measurement. The proposed method uses SMPL (Skinned Multi-Person Linear model), a human body model, and rich correspondences of Dense-Pose network so named Dense-Pose2SMPL, which estimates the SMPL parameters estimation by minimizing the re-projection error of the correspondences between the pixels in the human image and 3D surface points in SMPL. The previous SMPL parameter estimation methods use the sparse joint correspondence so that they show very limited performance in shape estimation. We compare the body measurement accuracy of Dense-Pose2SMPL with a single human image with SMPLify, a joint-based estimation method, and DecoMR, a Dense-Pose-based neural network regression method. The experiments results show a dramatic improvement of Dense-Pose2SMP over SMPLify and DecoMR. In the circumference estimation error, over 30 percent decrease for the overweight and underweight and 10 to 20 percent decrease on average. We also provide an analysis of the effects of the input conditions: the subject’s BMI level, pose, clothing style, and camera viewpoint. A-pose, side (profile) camera views and minimal and tight clothing style show higher accuracy than other conditions. Finally, the extension with multiple (two) images can give around 15 percent more improvement in body size estimation accuracy over the single image-based method. |
| first_indexed | 2024-04-12T08:06:21Z |
| format | Article |
| id | doaj.art-1d5c781c1ff142bb92d83ebfaf019ac6 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-12T08:06:21Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-1d5c781c1ff142bb92d83ebfaf019ac62022-12-22T03:41:09ZengIEEEIEEE Access2169-35362022-01-0110758597587110.1109/ACCESS.2022.31916449831448Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance StudyDongjun Gu0https://orcid.org/0000-0001-7804-0254Youngsik Yun1https://orcid.org/0000-0003-4398-7856Thai Thanh Tuan2https://orcid.org/0000-0003-2748-0529Heejune Ahn3https://orcid.org/0000-0003-1271-9998Department of Electrical and Information Engineering, Seoul National University of Science and Technology, Seoul, South KoreaDepartment of Electrical and Information Engineering, Seoul National University of Science and Technology, Seoul, South KoreaDepartment of Electrical and Information Engineering, Seoul National University of Science and Technology, Seoul, South KoreaDepartment of Electrical and Information Engineering, Seoul National University of Science and Technology, Seoul, South KoreaThe shape and pose estimation of a human body are essential for human behavior analysis, sports and medical analysis, and virtual reality. Although 2D image data are much easier to acquire than 3D scan data, the estimation accuracy using 2D images is still far below the 3D scanning methods’ ones. In this paper, we propose a 2D image-based human body estimation method appropriate for body shape and size measurement. The proposed method uses SMPL (Skinned Multi-Person Linear model), a human body model, and rich correspondences of Dense-Pose network so named Dense-Pose2SMPL, which estimates the SMPL parameters estimation by minimizing the re-projection error of the correspondences between the pixels in the human image and 3D surface points in SMPL. The previous SMPL parameter estimation methods use the sparse joint correspondence so that they show very limited performance in shape estimation. We compare the body measurement accuracy of Dense-Pose2SMPL with a single human image with SMPLify, a joint-based estimation method, and DecoMR, a Dense-Pose-based neural network regression method. The experiments results show a dramatic improvement of Dense-Pose2SMP over SMPLify and DecoMR. In the circumference estimation error, over 30 percent decrease for the overweight and underweight and 10 to 20 percent decrease on average. We also provide an analysis of the effects of the input conditions: the subject’s BMI level, pose, clothing style, and camera viewpoint. A-pose, side (profile) camera views and minimal and tight clothing style show higher accuracy than other conditions. Finally, the extension with multiple (two) images can give around 15 percent more improvement in body size estimation accuracy over the single image-based method.https://ieeexplore.ieee.org/document/9831448/Human body measurementhuman body modelshape and poseoptimization methodsSMPLDense-Pose |
| spellingShingle | Dongjun Gu Youngsik Yun Thai Thanh Tuan Heejune Ahn Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study IEEE Access Human body measurement human body model shape and pose optimization methods SMPL Dense-Pose |
| title | Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study |
| title_full | Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study |
| title_fullStr | Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study |
| title_full_unstemmed | Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study |
| title_short | Dense-Pose2SMPL: 3D Human Body Shape Estimation From a Single and Multiple Images and Its Performance Study |
| title_sort | dense pose2smpl 3d human body shape estimation from a single and multiple images and its performance study |
| topic | Human body measurement human body model shape and pose optimization methods SMPL Dense-Pose |
| url | https://ieeexplore.ieee.org/document/9831448/ |
| work_keys_str_mv | AT dongjungu densepose2smpl3dhumanbodyshapeestimationfromasingleandmultipleimagesanditsperformancestudy AT youngsikyun densepose2smpl3dhumanbodyshapeestimationfromasingleandmultipleimagesanditsperformancestudy AT thaithanhtuan densepose2smpl3dhumanbodyshapeestimationfromasingleandmultipleimagesanditsperformancestudy AT heejuneahn densepose2smpl3dhumanbodyshapeestimationfromasingleandmultipleimagesanditsperformancestudy |