Multiscale feature fusion network for monocular complex hand pose estimation

Abstract Hand pose estimation based on a single RGB image has low accuracy due to the complexity of the pose, local self‐similarity of finger features, and occlusion. A multiscale feature fusion network (MS‐FF) for monocular vision gesture pose estimation is proposed to address this problem. The net...

Full description

Bibliographic Details
Main Authors: Zhi Zhan, Guang Luo
Format: Article
Language:English
Published: Wiley 2023-12-01
Series:Electronics Letters
Subjects:
Online Access:https://doi.org/10.1049/ell2.13044
Description
Summary:Abstract Hand pose estimation based on a single RGB image has low accuracy due to the complexity of the pose, local self‐similarity of finger features, and occlusion. A multiscale feature fusion network (MS‐FF) for monocular vision gesture pose estimation is proposed to address this problem. The network can take full advantage of different channel information to enhance important gesture information, and it can simultaneously extract features from feature maps of different resolutions to obtain as much detailed feature information and deep semantic information as possible. The feature maps are merged to obtain the hand pose results. The InterHand2.6M dataset and Rendered Handpose Dataset (RHD) are used to train the MS‐FF. Compared with the other methods, the MS‐FF obtains the smallest average error of hand joints, verifying its effectiveness.
ISSN:0013-5194
1350-911X