Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language
Sign language uses gestures instead of speech sound to communicate. However, it is rare that the normal people try to learn the sign language for interacting with deaf people. Therefore, the need for a translation from sign language to written or oral language becomes important. In this paper, we p...
Main Authors: | , , |
---|---|
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2014
|
Subjects: | |
Online Access: | https://repository.ugm.ac.id/101163/1/2014_ICITEE.pdf |
_version_ | 1797032853940207616 |
---|---|
author | Hartanto, Rudy Susanto, Adhi Santosa, Paulus Insap |
author_facet | Hartanto, Rudy Susanto, Adhi Santosa, Paulus Insap |
author_sort | Hartanto, Rudy |
collection | UGM |
description | Sign language uses gestures instead of speech sound to communicate. However, it is rare that the normal people try to learn the sign language for interacting with deaf people. Therefore, the need for a translation from sign language to
written or oral language becomes important. In this paper, we propose a prototype system that can recognize the hand gesture sign language in real time. We use HSV (Hue Saturation Value) color space combined with skin detection to remove the complex background and create segmented images. Then a contour detection is applied to localize and save hand area. Further, we use SURF algorithm to detect and extract key point features and recognize each hand gesture sign alphabet by comparing with these user image database.
Based on the experiments, the system is capable to recognize hand gesture sign and translate to Alphabets, with recognize rate 63 % in average. |
first_indexed | 2024-03-13T22:45:00Z |
format | Conference or Workshop Item |
id | oai:generic.eprints.org:101163 |
institution | Universiti Gadjah Mada |
language | English |
last_indexed | 2024-03-13T22:45:00Z |
publishDate | 2014 |
record_format | dspace |
spelling | oai:generic.eprints.org:1011632015-02-27T01:21:22Z https://repository.ugm.ac.id/101163/ Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language Hartanto, Rudy Susanto, Adhi Santosa, Paulus Insap Information Technology Sign language uses gestures instead of speech sound to communicate. However, it is rare that the normal people try to learn the sign language for interacting with deaf people. Therefore, the need for a translation from sign language to written or oral language becomes important. In this paper, we propose a prototype system that can recognize the hand gesture sign language in real time. We use HSV (Hue Saturation Value) color space combined with skin detection to remove the complex background and create segmented images. Then a contour detection is applied to localize and save hand area. Further, we use SURF algorithm to detect and extract key point features and recognize each hand gesture sign alphabet by comparing with these user image database. Based on the experiments, the system is capable to recognize hand gesture sign and translate to Alphabets, with recognize rate 63 % in average. 2014-10-07 Conference or Workshop Item PeerReviewed application/pdf en https://repository.ugm.ac.id/101163/1/2014_ICITEE.pdf Hartanto, Rudy and Susanto, Adhi and Santosa, Paulus Insap (2014) Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language. In: 2014 6th International Conference on Information Technology and Electrical Engineering, 7-8 October 2014, 7-8 October 2014, Yogyakarta, Indonesia. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7007911 |
spellingShingle | Information Technology Hartanto, Rudy Susanto, Adhi Santosa, Paulus Insap Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language |
title | Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language |
title_full | Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language |
title_fullStr | Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language |
title_full_unstemmed | Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language |
title_short | Real Time Static Hand Gesture Recognition System Prototype for Indonesian Sign Language |
title_sort | real time static hand gesture recognition system prototype for indonesian sign language |
topic | Information Technology |
url | https://repository.ugm.ac.id/101163/1/2014_ICITEE.pdf |
work_keys_str_mv | AT hartantorudy realtimestatichandgesturerecognitionsystemprototypeforindonesiansignlanguage AT susantoadhi realtimestatichandgesturerecognitionsystemprototypeforindonesiansignlanguage AT santosapaulusinsap realtimestatichandgesturerecognitionsystemprototypeforindonesiansignlanguage |