Malaysian Sign Language Recognition Using Skeleton Data with Neural Network
This paper proposed the Backpropagation Neural Network (BNN) for recognition of Malaysian Sign Language. The image acquisition is done with the help of skeletal tracking using a Kinect camera. The data samples tested there are 15 dynamic signs taken from the Malaysian Sign Language (MySL). Pre-proce...
| Main Authors: | , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
2015
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/10543/1/Malaysian%20Sign%20Language%20Recognition%20Using%20Skeleton%20Data%20with%20Neural%20Network.pdf |
| _version_ | 1796990814317969408 |
|---|---|
| author | Sutarman, na Jasni, Mohamad Zain Mazlina, Abdul Majid Arief, Hermawan |
| author_facet | Sutarman, na Jasni, Mohamad Zain Mazlina, Abdul Majid Arief, Hermawan |
| author_sort | Sutarman, na |
| collection | UMP |
| description | This paper proposed the Backpropagation Neural Network (BNN) for recognition of Malaysian Sign Language. The image acquisition is done with the help of skeletal tracking using a Kinect camera. The data samples tested there are 15 dynamic signs taken from the Malaysian Sign Language (MySL). Pre-processing in this study was based on skeleton tracking the joints, to produce 3D coordinates X, Y, Z. The sample of Data 3D coordinates X, Y, and Z is taken a value relative to the Spine and head. The feature extraction is done by normalizing the position and size of the user, by taking eight out of 20 joints contributed in identifying the movement with the hand, left hand, right hand, left wrist, right wrist, left elbow, right elbow, Spine, Head. We use spherical coordinate conversion process and grouping frame used mean function. Two different approaches are evaluated: (1) the Cartesian coordinates (X, Y, and Z) of the six used joints and number of group's frames 14. The classifier used is the Neural Network (Cartesian + ANN); (2) the spherical coordinates (X, Y, and Z) and number of group's frame 14. The classifier used is Neural Network (Spherical+ANN). The experimental results of the Cartesian coordinate, and Artificial Neural Network (ANN) is the best of the neuron hidden layer 150, the best average recognition rate 80.54% with ± 2.07%, maximum 82.61% and minimum 78.47%. The increase at the recognition rate of Cartesian Coordinate+ANN with Spherical coordinates is 12.93%. |
| first_indexed | 2024-03-06T11:57:08Z |
| format | Conference or Workshop Item |
| id | UMPir10543 |
| institution | Universiti Malaysia Pahang |
| language | English |
| last_indexed | 2024-03-06T11:57:08Z |
| publishDate | 2015 |
| record_format | dspace |
| spelling | UMPir105432018-05-22T02:06:35Z http://umpir.ump.edu.my/id/eprint/10543/ Malaysian Sign Language Recognition Using Skeleton Data with Neural Network Sutarman, na Jasni, Mohamad Zain Mazlina, Abdul Majid Arief, Hermawan QA76 Computer software This paper proposed the Backpropagation Neural Network (BNN) for recognition of Malaysian Sign Language. The image acquisition is done with the help of skeletal tracking using a Kinect camera. The data samples tested there are 15 dynamic signs taken from the Malaysian Sign Language (MySL). Pre-processing in this study was based on skeleton tracking the joints, to produce 3D coordinates X, Y, Z. The sample of Data 3D coordinates X, Y, and Z is taken a value relative to the Spine and head. The feature extraction is done by normalizing the position and size of the user, by taking eight out of 20 joints contributed in identifying the movement with the hand, left hand, right hand, left wrist, right wrist, left elbow, right elbow, Spine, Head. We use spherical coordinate conversion process and grouping frame used mean function. Two different approaches are evaluated: (1) the Cartesian coordinates (X, Y, and Z) of the six used joints and number of group's frames 14. The classifier used is the Neural Network (Cartesian + ANN); (2) the spherical coordinates (X, Y, and Z) and number of group's frame 14. The classifier used is Neural Network (Spherical+ANN). The experimental results of the Cartesian coordinate, and Artificial Neural Network (ANN) is the best of the neuron hidden layer 150, the best average recognition rate 80.54% with ± 2.07%, maximum 82.61% and minimum 78.47%. The increase at the recognition rate of Cartesian Coordinate+ANN with Spherical coordinates is 12.93%. 2015 Conference or Workshop Item PeerReviewed application/pdf en http://umpir.ump.edu.my/id/eprint/10543/1/Malaysian%20Sign%20Language%20Recognition%20Using%20Skeleton%20Data%20with%20Neural%20Network.pdf Sutarman, na and Jasni, Mohamad Zain and Mazlina, Abdul Majid and Arief, Hermawan (2015) Malaysian Sign Language Recognition Using Skeleton Data with Neural Network. In: International Conference on Science in Information Technology (ICSITECH 2015) , 27-28 Oct 2015 , Yogjakarta, Indonesia. . (Unpublished) |
| spellingShingle | QA76 Computer software Sutarman, na Jasni, Mohamad Zain Mazlina, Abdul Majid Arief, Hermawan Malaysian Sign Language Recognition Using Skeleton Data with Neural Network |
| title | Malaysian Sign Language Recognition Using Skeleton Data with Neural Network |
| title_full | Malaysian Sign Language Recognition Using Skeleton Data with Neural Network |
| title_fullStr | Malaysian Sign Language Recognition Using Skeleton Data with Neural Network |
| title_full_unstemmed | Malaysian Sign Language Recognition Using Skeleton Data with Neural Network |
| title_short | Malaysian Sign Language Recognition Using Skeleton Data with Neural Network |
| title_sort | malaysian sign language recognition using skeleton data with neural network |
| topic | QA76 Computer software |
| url | http://umpir.ump.edu.my/id/eprint/10543/1/Malaysian%20Sign%20Language%20Recognition%20Using%20Skeleton%20Data%20with%20Neural%20Network.pdf |
| work_keys_str_mv | AT sutarmanna malaysiansignlanguagerecognitionusingskeletondatawithneuralnetwork AT jasnimohamadzain malaysiansignlanguagerecognitionusingskeletondatawithneuralnetwork AT mazlinaabdulmajid malaysiansignlanguagerecognitionusingskeletondatawithneuralnetwork AT ariefhermawan malaysiansignlanguagerecognitionusingskeletondatawithneuralnetwork |