Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data

In this paper we present an approach towards real-time hand gesture recognition using the Kinect sensor, investigating several machine learning techniques. We propose a novel approach for feature extraction, using measurements on joints of the extracted skeletons. The proposed features extract angle...

Full description

Bibliographic Details
Main Authors: Georgios Paraskevopoulos, Evaggelos Spyrou, Dimitrios Sgouropoulos, Theodoros Giannakopoulos, Phivos Mylonas
Format: Article
Language:English
Published: MDPI AG 2019-05-01
Series:Algorithms
Subjects:
Online Access:https://www.mdpi.com/1999-4893/12/5/108
_version_ 1824026931483377664
author Georgios Paraskevopoulos
Evaggelos Spyrou
Dimitrios Sgouropoulos
Theodoros Giannakopoulos
Phivos Mylonas
author_facet Georgios Paraskevopoulos
Evaggelos Spyrou
Dimitrios Sgouropoulos
Theodoros Giannakopoulos
Phivos Mylonas
author_sort Georgios Paraskevopoulos
collection DOAJ
description In this paper we present an approach towards real-time hand gesture recognition using the Kinect sensor, investigating several machine learning techniques. We propose a novel approach for feature extraction, using measurements on joints of the extracted skeletons. The proposed features extract angles and displacements of skeleton joints, as the latter move into a 3D space. We define a set of gestures and construct a real-life data set. We train gesture classifiers under the assumptions that they shall be applied and evaluated to both known and unknown users. Experimental results with 11 classification approaches prove the effectiveness and the potential of our approach both with the proposed dataset and also compared to state-of-the-art research works.
first_indexed 2024-12-19T11:18:51Z
format Article
id doaj.art-854c4fe4eecc4dfc9d0251bf115306c7
institution Directory Open Access Journal
issn 1999-4893
language English
last_indexed 2024-12-19T11:18:51Z
publishDate 2019-05-01
publisher MDPI AG
record_format Article
series Algorithms
spelling doaj.art-854c4fe4eecc4dfc9d0251bf115306c72022-12-21T20:23:56ZengMDPI AGAlgorithms1999-48932019-05-0112510810.3390/a12050108a12050108Real-Time Arm Gesture Recognition Using 3D Skeleton Joint DataGeorgios Paraskevopoulos0Evaggelos Spyrou1Dimitrios Sgouropoulos2Theodoros Giannakopoulos3Phivos Mylonas4School of Electrical and Computer Engineering, National Technical University of Athens, Iroon Polytechneiou 9, 157 73 Zografou, GreeceInstitute of Informatics and Telecommunications, NCSR Demokritos, Neapoleos 10, 153 41 Ag. Paraskevi, GreeceInstitute of Informatics and Telecommunications, NCSR Demokritos, Neapoleos 10, 153 41 Ag. Paraskevi, GreeceInstitute of Informatics and Telecommunications, NCSR Demokritos, Neapoleos 10, 153 41 Ag. Paraskevi, GreeceDepartment of Informatics, Ionian University, Platia Tsirigoti 7, 491 00 Corfu, GreeceIn this paper we present an approach towards real-time hand gesture recognition using the Kinect sensor, investigating several machine learning techniques. We propose a novel approach for feature extraction, using measurements on joints of the extracted skeletons. The proposed features extract angles and displacements of skeleton joints, as the latter move into a 3D space. We define a set of gestures and construct a real-life data set. We train gesture classifiers under the assumptions that they shall be applied and evaluated to both known and unknown users. Experimental results with 11 classification approaches prove the effectiveness and the potential of our approach both with the proposed dataset and also compared to state-of-the-art research works.https://www.mdpi.com/1999-4893/12/5/108gesture recognitionKinectskeleton jointsmachine learning
spellingShingle Georgios Paraskevopoulos
Evaggelos Spyrou
Dimitrios Sgouropoulos
Theodoros Giannakopoulos
Phivos Mylonas
Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data
Algorithms
gesture recognition
Kinect
skeleton joints
machine learning
title Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data
title_full Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data
title_fullStr Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data
title_full_unstemmed Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data
title_short Real-Time Arm Gesture Recognition Using 3D Skeleton Joint Data
title_sort real time arm gesture recognition using 3d skeleton joint data
topic gesture recognition
Kinect
skeleton joints
machine learning
url https://www.mdpi.com/1999-4893/12/5/108
work_keys_str_mv AT georgiosparaskevopoulos realtimearmgesturerecognitionusing3dskeletonjointdata
AT evaggelosspyrou realtimearmgesturerecognitionusing3dskeletonjointdata
AT dimitriossgouropoulos realtimearmgesturerecognitionusing3dskeletonjointdata
AT theodorosgiannakopoulos realtimearmgesturerecognitionusing3dskeletonjointdata
AT phivosmylonas realtimearmgesturerecognitionusing3dskeletonjointdata