Dynamic Human Body Modeling Using a Single RGB Camera
In this paper, we present a novel automatic pipeline to build personalized parametric models of dynamic people using a single RGB camera. Compared to previous approaches that use monocular RGB images, our system can model a 3D human body automatically and incrementally, taking advantage of human mot...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2016-03-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/16/3/402 |
| _version_ | 1811280755951665152 |
|---|---|
| author | Haiyu Zhu Yao Yu Yu Zhou Sidan Du |
| author_facet | Haiyu Zhu Yao Yu Yu Zhou Sidan Du |
| author_sort | Haiyu Zhu |
| collection | DOAJ |
| description | In this paper, we present a novel automatic pipeline to build personalized parametric models of dynamic people using a single RGB camera. Compared to previous approaches that use monocular RGB images, our system can model a 3D human body automatically and incrementally, taking advantage of human motion. Based on coarse 2D and 3D poses estimated from image sequences, we first perform a kinematic classification of human body parts to refine the poses and obtain reconstructed body parts. Next, a personalized parametric human model is generated by driving a general template to fit the body parts and calculating the non-rigid deformation. Experimental results show that our shape estimation method achieves comparable accuracy with reconstructed models using depth cameras, yet requires neither user interaction nor any dedicated devices, leading to the feasibility of using this method on widely available smart phones. |
| first_indexed | 2024-04-13T01:20:30Z |
| format | Article |
| id | doaj.art-ee35725068c8424c8498dceb5a6a2136 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-13T01:20:30Z |
| publishDate | 2016-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-ee35725068c8424c8498dceb5a6a21362022-12-22T03:08:47ZengMDPI AGSensors1424-82202016-03-0116340210.3390/s16030402s16030402Dynamic Human Body Modeling Using a Single RGB CameraHaiyu Zhu0Yao Yu1Yu Zhou2Sidan Du3School of Electronic Science and Engineering, Nanjing University, Nanjing 210023, ChinaSchool of Electronic Science and Engineering, Nanjing University, Nanjing 210023, ChinaSchool of Electronic Science and Engineering, Nanjing University, Nanjing 210023, ChinaSchool of Electronic Science and Engineering, Nanjing University, Nanjing 210023, ChinaIn this paper, we present a novel automatic pipeline to build personalized parametric models of dynamic people using a single RGB camera. Compared to previous approaches that use monocular RGB images, our system can model a 3D human body automatically and incrementally, taking advantage of human motion. Based on coarse 2D and 3D poses estimated from image sequences, we first perform a kinematic classification of human body parts to refine the poses and obtain reconstructed body parts. Next, a personalized parametric human model is generated by driving a general template to fit the body parts and calculating the non-rigid deformation. Experimental results show that our shape estimation method achieves comparable accuracy with reconstructed models using depth cameras, yet requires neither user interaction nor any dedicated devices, leading to the feasibility of using this method on widely available smart phones.http://www.mdpi.com/1424-8220/16/3/402SCAPEnon-rigid reconstructionsingle RGB camerapose estimationmotion classificationstructure from motion |
| spellingShingle | Haiyu Zhu Yao Yu Yu Zhou Sidan Du Dynamic Human Body Modeling Using a Single RGB Camera Sensors SCAPE non-rigid reconstruction single RGB camera pose estimation motion classification structure from motion |
| title | Dynamic Human Body Modeling Using a Single RGB Camera |
| title_full | Dynamic Human Body Modeling Using a Single RGB Camera |
| title_fullStr | Dynamic Human Body Modeling Using a Single RGB Camera |
| title_full_unstemmed | Dynamic Human Body Modeling Using a Single RGB Camera |
| title_short | Dynamic Human Body Modeling Using a Single RGB Camera |
| title_sort | dynamic human body modeling using a single rgb camera |
| topic | SCAPE non-rigid reconstruction single RGB camera pose estimation motion classification structure from motion |
| url | http://www.mdpi.com/1424-8220/16/3/402 |
| work_keys_str_mv | AT haiyuzhu dynamichumanbodymodelingusingasinglergbcamera AT yaoyu dynamichumanbodymodelingusingasinglergbcamera AT yuzhou dynamichumanbodymodelingusingasinglergbcamera AT sidandu dynamichumanbodymodelingusingasinglergbcamera |