CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION
In several conditions, teleoperated robot system is very useful in solving severe task in which autonomous robot cannot. Commanding in robot teleoperation system can be done in several ways, including the use of hand gesture. Hand gestures are often used as natural interface between human and robot....
| Main Authors: | , |
|---|---|
| Format: | Thesis |
| Published: |
[Yogyakarta] : Universitas Gadjah Mada
2012
|
| Subjects: |
| _version_ | 1797032736270057472 |
|---|---|
| author | , Rayi Yanu Tara , Ir. P. Insap Santosa, M. Sc., Ph.D |
| author_facet | , Rayi Yanu Tara , Ir. P. Insap Santosa, M. Sc., Ph.D |
| author_sort | , Rayi Yanu Tara |
| collection | UGM |
| description | In several conditions, teleoperated robot system is very useful in solving
severe task in which autonomous robot cannot. Commanding in robot
teleoperation system can be done in several ways, including the use of hand
gesture. Hand gestures are often used as natural interface between human and
robot. Hand shape can gives information in recognizing hand gesture.
Recognizing hand gesture involves several steps.
In this research, the use of Centroid distance Fourier Descriptors (CeFD)
as hand shape descriptor in hand gesture recognition from visually captured hand
gesture is presented. The hand gesture recognition will be used as robot
teleoperation command. Five static gestures, which are adopted from ASL
fingerspelling, are employed in this research. A gesture dictionary is built as a
reference of each gesture. A combination of Nearest Neighbor (NN) classifier and
several distance metrics as gesture recognition system are investigated.
Hand gesture acquisition utilizes Microsoft Kinect as a depth imager. An
analysis of human posture dimension is performed to specify several parameters,
which are used to threshold the acquired depth image. By finding the centroid of
human location in the image, the position of left and right hand can be located.
Thus, both hand images can be segmented. Centroid distance signature is
constructed from the segmented hand contours as a hand shape signature. Fourier
transformation of the centroid distance signature results in fourier descriptors of
the hand shape. The fourier descriptors of hand gesture are then compared with
the gesture dictionary to perform gesture recognition.
Several experiments show the presented system performances. In the
segmentation step, the thresholding operation results in completely segmented
hand images. This segmentation method has low computation time and works
well with an assumption that human hands are positioned ahead of human body.
The use of 15 fourier descriptors as feature vector and Manhattan distance in
Nearest Neighbor classifier achieves the best recognition rates of 95% with small
computation latency of 6.23556 ms. Real-time implementation of the presented
system is applicable due to its processing speed is faster than the imager
acquisition rate. |
| first_indexed | 2024-03-13T22:43:03Z |
| format | Thesis |
| id | oai:generic.eprints.org:100570 |
| institution | Universiti Gadjah Mada |
| last_indexed | 2024-03-13T22:43:03Z |
| publishDate | 2012 |
| publisher | [Yogyakarta] : Universitas Gadjah Mada |
| record_format | dspace |
| spelling | oai:generic.eprints.org:1005702016-03-04T08:48:31Z https://repository.ugm.ac.id/100570/ CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION , Rayi Yanu Tara , Ir. P. Insap Santosa, M. Sc., Ph.D ETD In several conditions, teleoperated robot system is very useful in solving severe task in which autonomous robot cannot. Commanding in robot teleoperation system can be done in several ways, including the use of hand gesture. Hand gestures are often used as natural interface between human and robot. Hand shape can gives information in recognizing hand gesture. Recognizing hand gesture involves several steps. In this research, the use of Centroid distance Fourier Descriptors (CeFD) as hand shape descriptor in hand gesture recognition from visually captured hand gesture is presented. The hand gesture recognition will be used as robot teleoperation command. Five static gestures, which are adopted from ASL fingerspelling, are employed in this research. A gesture dictionary is built as a reference of each gesture. A combination of Nearest Neighbor (NN) classifier and several distance metrics as gesture recognition system are investigated. Hand gesture acquisition utilizes Microsoft Kinect as a depth imager. An analysis of human posture dimension is performed to specify several parameters, which are used to threshold the acquired depth image. By finding the centroid of human location in the image, the position of left and right hand can be located. Thus, both hand images can be segmented. Centroid distance signature is constructed from the segmented hand contours as a hand shape signature. Fourier transformation of the centroid distance signature results in fourier descriptors of the hand shape. The fourier descriptors of hand gesture are then compared with the gesture dictionary to perform gesture recognition. Several experiments show the presented system performances. In the segmentation step, the thresholding operation results in completely segmented hand images. This segmentation method has low computation time and works well with an assumption that human hands are positioned ahead of human body. The use of 15 fourier descriptors as feature vector and Manhattan distance in Nearest Neighbor classifier achieves the best recognition rates of 95% with small computation latency of 6.23556 ms. Real-time implementation of the presented system is applicable due to its processing speed is faster than the imager acquisition rate. [Yogyakarta] : Universitas Gadjah Mada 2012 Thesis NonPeerReviewed , Rayi Yanu Tara and , Ir. P. Insap Santosa, M. Sc., Ph.D (2012) CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION. UNSPECIFIED thesis, UNSPECIFIED. http://etd.ugm.ac.id/index.php?mod=penelitian_detail&sub=PenelitianDetail&act=view&typ=html&buku_id=57071 |
| spellingShingle | ETD , Rayi Yanu Tara , Ir. P. Insap Santosa, M. Sc., Ph.D CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION |
| title | CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION |
| title_full | CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION |
| title_fullStr | CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION |
| title_full_unstemmed | CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION |
| title_short | CENTROID DISTANCE FOURIER DESCRIPTOR FOR SHAPE-BASED HAND GESTURE RECOGNITION IN MOBILE ROBOT TELEOPERATION |
| title_sort | centroid distance fourier descriptor for shape based hand gesture recognition in mobile robot teleoperation |
| topic | ETD |
| work_keys_str_mv | AT rayiyanutara centroiddistancefourierdescriptorforshapebasedhandgesturerecognitioninmobilerobotteleoperation AT irpinsapsantosamscphd centroiddistancefourierdescriptorforshapebasedhandgesturerecognitioninmobilerobotteleoperation |