3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge
3D human pose estimation is more and more widely used in the real world, such as sports guidance, limb rehabilitation training, augmented reality, and intelligent security. Most existing human pose estimation methods are designed based on an RGB image obtained by one optical sensor, such as a digita...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-02-01
|
| Series: | Frontiers in Physics |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fphy.2021.629288/full |
| _version_ | 1818409510866255872 |
|---|---|
| author | Lu Meng Hengshang Gao |
| author_facet | Lu Meng Hengshang Gao |
| author_sort | Lu Meng |
| collection | DOAJ |
| description | 3D human pose estimation is more and more widely used in the real world, such as sports guidance, limb rehabilitation training, augmented reality, and intelligent security. Most existing human pose estimation methods are designed based on an RGB image obtained by one optical sensor, such as a digital camera. There is some prior knowledge, such as bone proportion and angle limitation of joint hinge motion. However, the existing methods do not consider the correlation between different joints from multi-view images, and most of them adopt fixed spatial prior constraints, resulting in poor generalizations. Therefore, it is essential to build a multi-view image acquisition system using optical sensors and customized algorithms for a 3D reconstruction of the human pose in the image. Inspired by generative adversarial networks (GAN), we used a data-driven method to learn the implicit spatial prior information and classified joints according to the natural connection characteristics. To accelerate the proposed method, we proposed a fully connected network with skip connections and used the SMPL model to make the 3D human body reconstruction. Experimental results showed that compared with other state-of-the-art methods, the joints’ average error of the proposed method was the smallest, which indicated the best performance. Moreover, the running time of the proposed method was 1.3 seconds per frame, which may not meet real-time requirements, but is still much faster than most existing methods. |
| first_indexed | 2024-12-14T10:00:47Z |
| format | Article |
| id | doaj.art-d629785ca39b47c697a73001fe781a4a |
| institution | Directory Open Access Journal |
| issn | 2296-424X |
| language | English |
| last_indexed | 2024-12-14T10:00:47Z |
| publishDate | 2021-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Physics |
| spelling | doaj.art-d629785ca39b47c697a73001fe781a4a2022-12-21T23:07:17ZengFrontiers Media S.A.Frontiers in Physics2296-424X2021-02-01910.3389/fphy.2021.6292886292883D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior KnowledgeLu MengHengshang Gao3D human pose estimation is more and more widely used in the real world, such as sports guidance, limb rehabilitation training, augmented reality, and intelligent security. Most existing human pose estimation methods are designed based on an RGB image obtained by one optical sensor, such as a digital camera. There is some prior knowledge, such as bone proportion and angle limitation of joint hinge motion. However, the existing methods do not consider the correlation between different joints from multi-view images, and most of them adopt fixed spatial prior constraints, resulting in poor generalizations. Therefore, it is essential to build a multi-view image acquisition system using optical sensors and customized algorithms for a 3D reconstruction of the human pose in the image. Inspired by generative adversarial networks (GAN), we used a data-driven method to learn the implicit spatial prior information and classified joints according to the natural connection characteristics. To accelerate the proposed method, we proposed a fully connected network with skip connections and used the SMPL model to make the 3D human body reconstruction. Experimental results showed that compared with other state-of-the-art methods, the joints’ average error of the proposed method was the smallest, which indicated the best performance. Moreover, the running time of the proposed method was 1.3 seconds per frame, which may not meet real-time requirements, but is still much faster than most existing methods.https://www.frontiersin.org/articles/10.3389/fphy.2021.629288/full3D human pose estimationfully connected neural networkhourglass networkSMPL modelgenerative adversarial networks |
| spellingShingle | Lu Meng Hengshang Gao 3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge Frontiers in Physics 3D human pose estimation fully connected neural network hourglass network SMPL model generative adversarial networks |
| title | 3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge |
| title_full | 3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge |
| title_fullStr | 3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge |
| title_full_unstemmed | 3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge |
| title_short | 3D Human Pose Estimation Based on a Fully Connected Neural Network With Adversarial Learning Prior Knowledge |
| title_sort | 3d human pose estimation based on a fully connected neural network with adversarial learning prior knowledge |
| topic | 3D human pose estimation fully connected neural network hourglass network SMPL model generative adversarial networks |
| url | https://www.frontiersin.org/articles/10.3389/fphy.2021.629288/full |
| work_keys_str_mv | AT lumeng 3dhumanposeestimationbasedonafullyconnectedneuralnetworkwithadversariallearningpriorknowledge AT hengshanggao 3dhumanposeestimationbasedonafullyconnectedneuralnetworkwithadversariallearningpriorknowledge |