Hand Gesture Modeling and Recognition for Human and Robot Interactive Assembly Using Hidden Markov Models

Gesture recognition is essential for human and robot collaboration. Within an industrial hybrid assembly cell, the performance of such a system significantly affects the safety of human workers. This work presents an approach to recognizing hand gestures accurately during an assembly task while in c...

Full description

Bibliographic Details
Main Authors: Fei Chen, Qiubo Zhong, Ferdinando Cannella, Kosuke Sekiyama, Toshio Fukuda
Format: Article
Language:English
Published: SAGE Publishing 2015-04-01
Series:International Journal of Advanced Robotic Systems
Online Access:https://doi.org/10.5772/60044
Description
Summary:Gesture recognition is essential for human and robot collaboration. Within an industrial hybrid assembly cell, the performance of such a system significantly affects the safety of human workers. This work presents an approach to recognizing hand gestures accurately during an assembly task while in collaboration with a robot co-worker. We have designed and developed a sensor system for measuring natural human-robot interactions. The position and rotation information of a human worker's hands and fingertips are tracked in 3D space while completing a task. A modified chain-code method is proposed to describe the motion trajectory of the measured hands and fingertips. The Hidden Markov Model (HMM) method is adopted to recognize patterns via data streams and identify workers' gesture patterns and assembly intentions. The effectiveness of the proposed system is verified by experimental results. The outcome demonstrates that the proposed system is able to automatically segment the data streams and recognize the gesture patterns thus represented with a reasonable accuracy ratio.
ISSN:1729-8814