Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model
Hand gesture recognition is an important topic in human-computer interaction. With the rapid development of 3D sensors, gesture recognition methods using 3D input images have become mainstream. However, most of the current methods are based on depth maps and do not take full advantage of 3D informat...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10114949/ |
| _version_ | 1797805948060827648 |
|---|---|
| author | Yajun Pang Yujiang Gong Xianan Hao |
| author_facet | Yajun Pang Yujiang Gong Xianan Hao |
| author_sort | Yajun Pang |
| collection | DOAJ |
| description | Hand gesture recognition is an important topic in human-computer interaction. With the rapid development of 3D sensors, gesture recognition methods using 3D input images have become mainstream. However, most of the current methods are based on depth maps and do not take full advantage of 3D information. In addition, static gesture recognition usually uses only one frame for recognition and cannot make use of redundant gesture-forming frames. This paper proposes a static gesture recognition method based on point cloud sequences and an inverse kinematics model. In the initial posture with five fingers open, the input point cloud sequences are divided into boundary points for fingertips marking and inner points for deformed joints marking, which is based on the K-curvature algorithm and curvature difference respectively. And those joints that cannot be marked by curvature differences, their positions are estimated by inverse kinematics. Then the bending angles and fingertips position are selected as features, and the recognition is completed by KNN. The performance of the proposed method has been experimentally evaluated using self-sampled data, and the average recognition accuracy is about 96%. Besides, because of the use of higher-order geometric features, the proposed method is highly abstract, easy to construct and adjust, and highly adaptable to different application scenarios. |
| first_indexed | 2024-03-13T06:00:06Z |
| format | Article |
| id | doaj.art-61b0229f861b4d4a965ff60c37fd2c91 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T06:00:06Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-61b0229f861b4d4a965ff60c37fd2c912023-06-12T23:01:39ZengIEEEIEEE Access2169-35362023-01-0111440824409110.1109/ACCESS.2023.327274610114949Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics ModelYajun Pang0https://orcid.org/0000-0001-9492-7154Yujiang Gong1Xianan Hao2Center for Advanced Laser Technology, Hebei University of Technology, Tianjin, ChinaCenter for Advanced Laser Technology, Hebei University of Technology, Tianjin, ChinaCenter for Advanced Laser Technology, Hebei University of Technology, Tianjin, ChinaHand gesture recognition is an important topic in human-computer interaction. With the rapid development of 3D sensors, gesture recognition methods using 3D input images have become mainstream. However, most of the current methods are based on depth maps and do not take full advantage of 3D information. In addition, static gesture recognition usually uses only one frame for recognition and cannot make use of redundant gesture-forming frames. This paper proposes a static gesture recognition method based on point cloud sequences and an inverse kinematics model. In the initial posture with five fingers open, the input point cloud sequences are divided into boundary points for fingertips marking and inner points for deformed joints marking, which is based on the K-curvature algorithm and curvature difference respectively. And those joints that cannot be marked by curvature differences, their positions are estimated by inverse kinematics. Then the bending angles and fingertips position are selected as features, and the recognition is completed by KNN. The performance of the proposed method has been experimentally evaluated using self-sampled data, and the average recognition accuracy is about 96%. Besides, because of the use of higher-order geometric features, the proposed method is highly abstract, easy to construct and adjust, and highly adaptable to different application scenarios.https://ieeexplore.ieee.org/document/10114949/Hand gesture recognitionpoint cloudinverse kinematicsKNN |
| spellingShingle | Yajun Pang Yujiang Gong Xianan Hao Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model IEEE Access Hand gesture recognition point cloud inverse kinematics KNN |
| title | Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model |
| title_full | Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model |
| title_fullStr | Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model |
| title_full_unstemmed | Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model |
| title_short | Hand Gesture Recognition Based on Point Cloud Sequences and Inverse Kinematics Model |
| title_sort | hand gesture recognition based on point cloud sequences and inverse kinematics model |
| topic | Hand gesture recognition point cloud inverse kinematics KNN |
| url | https://ieeexplore.ieee.org/document/10114949/ |
| work_keys_str_mv | AT yajunpang handgesturerecognitionbasedonpointcloudsequencesandinversekinematicsmodel AT yujianggong handgesturerecognitionbasedonpointcloudsequencesandinversekinematicsmodel AT xiananhao handgesturerecognitionbasedonpointcloudsequencesandinversekinematicsmodel |