Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language

Sign language uses gestures instead of speech sound to communicate. However, it is rare that the normal people try to learn the sign language for interacting with deaf people. Therefore, the need for a translation from sign language to written or oral language becomes important. In this paper, we p...

Full description

Bibliographic Details
Main Authors: Hartanto, Rudy, Susanto, Adhi, Santosa, Paulus Insap
Format: Conference or Workshop Item
Language:English
Published: 2014
Subjects:
Online Access:https://repository.ugm.ac.id/101163/1/2014_ICITEE.pdf
_version_ 1797032853940207616
author Hartanto, Rudy
Susanto, Adhi
Santosa, Paulus Insap
author_facet Hartanto, Rudy
Susanto, Adhi
Santosa, Paulus Insap
author_sort Hartanto, Rudy
collection UGM
description Sign language uses gestures instead of speech sound to communicate. However, it is rare that the normal people try to learn the sign language for interacting with deaf people. Therefore, the need for a translation from sign language to written or oral language becomes important. In this paper, we propose a prototype system that can recognize the hand gesture sign language in real time. We use HSV (Hue Saturation Value) color space combined with skin detection to remove the complex background and create segmented images. Then a contour detection is applied to localize and save hand area. Further, we use SURF algorithm to detect and extract key point features and recognize each hand gesture sign alphabet by comparing with these user image database. Based on the experiments, the system is capable to recognize hand gesture sign and translate to Alphabets, with recognize rate 63 % in average.
first_indexed 2024-03-13T22:45:00Z
format Conference or Workshop Item
id oai:generic.eprints.org:101163
institution Universiti Gadjah Mada
language English
last_indexed 2024-03-13T22:45:00Z
publishDate 2014
record_format dspace
spelling oai:generic.eprints.org:1011632015-02-27T01:21:22Z https://repository.ugm.ac.id/101163/ Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language Hartanto, Rudy Susanto, Adhi Santosa, Paulus Insap Information Technology Sign language uses gestures instead of speech sound to communicate. However, it is rare that the normal people try to learn the sign language for interacting with deaf people. Therefore, the need for a translation from sign language to written or oral language becomes important. In this paper, we propose a prototype system that can recognize the hand gesture sign language in real time. We use HSV (Hue Saturation Value) color space combined with skin detection to remove the complex background and create segmented images. Then a contour detection is applied to localize and save hand area. Further, we use SURF algorithm to detect and extract key point features and recognize each hand gesture sign alphabet by comparing with these user image database. Based on the experiments, the system is capable to recognize hand gesture sign and translate to Alphabets, with recognize rate 63 % in average. 2014-10-07 Conference or Workshop Item PeerReviewed application/pdf en https://repository.ugm.ac.id/101163/1/2014_ICITEE.pdf Hartanto, Rudy and Susanto, Adhi and Santosa, Paulus Insap (2014) Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language. In: 2014 6th International Conference on Information Technology and Electrical Engineering, 7-8 October 2014, 7-8 October 2014, Yogyakarta, Indonesia. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7007911
spellingShingle Information Technology
Hartanto, Rudy
Susanto, Adhi
Santosa, Paulus Insap
Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
title Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
title_full Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
title_fullStr Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
title_full_unstemmed Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
title_short Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
title_sort real time static hand gesture recognition system prototype for indonesian sign language
topic Information Technology
url https://repository.ugm.ac.id/101163/1/2014_ICITEE.pdf
work_keys_str_mv AT hartantorudy realtimestatichandgesturerecognitionsystemprototypeforindonesiansignlanguage
AT susantoadhi realtimestatichandgesturerecognitionsystemprototypeforindonesiansignlanguage
AT santosapaulusinsap realtimestatichandgesturerecognitionsystemprototypeforindonesiansignlanguage