Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf
In Malaysia, Person with Disabilities (PWD) with hearing problems or commonly known as the deaf, struggle to have a conversation with the communities who do not know or how to do sign language efficiently. The consequence is hearing PWD received unequal treatment in jobs and learning opportunities....
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Penerbit UTM Press
2021
|
| Subjects: | |
| Online Access: | http://eprints.utm.my/98337/1/RuzairiAbdulRahim2021_DevelopmentofaMalaysianSignLanguage.pdf |
| _version_ | 1796866600807170048 |
|---|---|
| author | Mohammad, Nurul Ashikin Tee, Kian Sek Soon, Chin Fhong Sam, Toong Hai Abdul Rahim, Ruzairi |
| author_facet | Mohammad, Nurul Ashikin Tee, Kian Sek Soon, Chin Fhong Sam, Toong Hai Abdul Rahim, Ruzairi |
| author_sort | Mohammad, Nurul Ashikin |
| collection | ePrints |
| description | In Malaysia, Person with Disabilities (PWD) with hearing problems or commonly known as the deaf, struggle to have a conversation with the communities who do not know or how to do sign language efficiently. The consequence is hearing PWD received unequal treatment in jobs and learning opportunities. This project aims to develop a Malaysian Sign Language interpreter to convert hand signs to texts, in order to facilitate the conversation between hearing PWD and the communities. The system would implement a camera and vision system to capture images of hand signs. Four hand signs have been selected. Stacks of these images were processed digitally using deep learning method, and eventually the trained network could recognize the hand signs successfully. This feasible study suggests that the proposed setup could be further implemented to train more hand signs and enrich the hand signs-to-text vocabulary. |
| first_indexed | 2024-03-05T21:14:35Z |
| format | Article |
| id | utm.eprints-98337 |
| institution | Universiti Teknologi Malaysia - ePrints |
| language | English |
| last_indexed | 2024-03-05T21:14:35Z |
| publishDate | 2021 |
| publisher | Penerbit UTM Press |
| record_format | dspace |
| spelling | utm.eprints-983372022-12-07T07:34:50Z http://eprints.utm.my/98337/ Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf Mohammad, Nurul Ashikin Tee, Kian Sek Soon, Chin Fhong Sam, Toong Hai Abdul Rahim, Ruzairi TK Electrical engineering. Electronics Nuclear engineering In Malaysia, Person with Disabilities (PWD) with hearing problems or commonly known as the deaf, struggle to have a conversation with the communities who do not know or how to do sign language efficiently. The consequence is hearing PWD received unequal treatment in jobs and learning opportunities. This project aims to develop a Malaysian Sign Language interpreter to convert hand signs to texts, in order to facilitate the conversation between hearing PWD and the communities. The system would implement a camera and vision system to capture images of hand signs. Four hand signs have been selected. Stacks of these images were processed digitally using deep learning method, and eventually the trained network could recognize the hand signs successfully. This feasible study suggests that the proposed setup could be further implemented to train more hand signs and enrich the hand signs-to-text vocabulary. Penerbit UTM Press 2021-10-15 Article PeerReviewed application/pdf en http://eprints.utm.my/98337/1/RuzairiAbdulRahim2021_DevelopmentofaMalaysianSignLanguage.pdf Mohammad, Nurul Ashikin and Tee, Kian Sek and Soon, Chin Fhong and Sam, Toong Hai and Abdul Rahim, Ruzairi (2021) Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf. ELEKTRIKA- Journal of Electrical Engineering, 20 (2-3). pp. 70-72. ISSN 0128-4428 https://elektrika.utm.my/index.php/ELEKTRIKA_Journal/article/view/313 NA |
| spellingShingle | TK Electrical engineering. Electronics Nuclear engineering Mohammad, Nurul Ashikin Tee, Kian Sek Soon, Chin Fhong Sam, Toong Hai Abdul Rahim, Ruzairi Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf |
| title | Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf |
| title_full | Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf |
| title_fullStr | Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf |
| title_full_unstemmed | Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf |
| title_short | Development of a Malaysian Sign Language interpreter using image recognition for the community to understand the deaf |
| title_sort | development of a malaysian sign language interpreter using image recognition for the community to understand the deaf |
| topic | TK Electrical engineering. Electronics Nuclear engineering |
| url | http://eprints.utm.my/98337/1/RuzairiAbdulRahim2021_DevelopmentofaMalaysianSignLanguage.pdf |
| work_keys_str_mv | AT mohammadnurulashikin developmentofamalaysiansignlanguageinterpreterusingimagerecognitionforthecommunitytounderstandthedeaf AT teekiansek developmentofamalaysiansignlanguageinterpreterusingimagerecognitionforthecommunitytounderstandthedeaf AT soonchinfhong developmentofamalaysiansignlanguageinterpreterusingimagerecognitionforthecommunitytounderstandthedeaf AT samtoonghai developmentofamalaysiansignlanguageinterpreterusingimagerecognitionforthecommunitytounderstandthedeaf AT abdulrahimruzairi developmentofamalaysiansignlanguageinterpreterusingimagerecognitionforthecommunitytounderstandthedeaf |