Advances in machine translation for sign language: approaches, limitations, and challenges
Sign languages are used by the deaf community around the globe to communicate with one another. These are gesture-based languages where a deaf person performs gestures using hands and facial expressions. Every gesture represents a word or a phrase in the natural language. There are more than 200 dif...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
Springer Science and Business Media Deutschland GmbH
2021
|
| Subjects: |
| _version_ | 1796866109244178432 |
|---|---|
| author | Farooq, Uzma Mohd. Rahim, Mohd. Shafry Sabir, Nabeel Hussain, Amir Abid, Adnan |
| author_facet | Farooq, Uzma Mohd. Rahim, Mohd. Shafry Sabir, Nabeel Hussain, Amir Abid, Adnan |
| author_sort | Farooq, Uzma |
| collection | ePrints |
| description | Sign languages are used by the deaf community around the globe to communicate with one another. These are gesture-based languages where a deaf person performs gestures using hands and facial expressions. Every gesture represents a word or a phrase in the natural language. There are more than 200 different sign languages in the world. In order to facilitate the learning of sign languages by the deaf community, researchers have compiled sign language repositories comprising of gestures. Similarly, algorithms have been proposed to translate the natural language into sign language, which is subsequently converted into gestures using avatar technology. On the other hand, several different approaches for gesture recognition have also been proposed in the literature, many of which use specialized hardware. Similarly, cell phone applications have been developed for learning and translation of sign languages. This article presents a systematic literature review of these multidisciplinary aspects of sign language translation. It provides a detailed analysis of carefully selected 147 high-quality research articles and books related to the subject matter. Specifically, it categorizes different approaches used for each component, discusses their theoretical foundations, and provides a comparative analysis of the proposed approaches. Lastly, open research challenges and future directions for each facet of the sign language translation problem have been discussed. To the best of our knowledge, this is the first comprehensive survey on sign language translation that discusses state-of-the-art research from multi-disciplinary perspectives. |
| first_indexed | 2024-03-05T21:07:15Z |
| format | Article |
| id | utm.eprints-95875 |
| institution | Universiti Teknologi Malaysia - ePrints |
| last_indexed | 2024-03-05T21:07:15Z |
| publishDate | 2021 |
| publisher | Springer Science and Business Media Deutschland GmbH |
| record_format | dspace |
| spelling | utm.eprints-958752022-06-22T03:51:37Z http://eprints.utm.my/95875/ Advances in machine translation for sign language: approaches, limitations, and challenges Farooq, Uzma Mohd. Rahim, Mohd. Shafry Sabir, Nabeel Hussain, Amir Abid, Adnan QA75 Electronic computers. Computer science Sign languages are used by the deaf community around the globe to communicate with one another. These are gesture-based languages where a deaf person performs gestures using hands and facial expressions. Every gesture represents a word or a phrase in the natural language. There are more than 200 different sign languages in the world. In order to facilitate the learning of sign languages by the deaf community, researchers have compiled sign language repositories comprising of gestures. Similarly, algorithms have been proposed to translate the natural language into sign language, which is subsequently converted into gestures using avatar technology. On the other hand, several different approaches for gesture recognition have also been proposed in the literature, many of which use specialized hardware. Similarly, cell phone applications have been developed for learning and translation of sign languages. This article presents a systematic literature review of these multidisciplinary aspects of sign language translation. It provides a detailed analysis of carefully selected 147 high-quality research articles and books related to the subject matter. Specifically, it categorizes different approaches used for each component, discusses their theoretical foundations, and provides a comparative analysis of the proposed approaches. Lastly, open research challenges and future directions for each facet of the sign language translation problem have been discussed. To the best of our knowledge, this is the first comprehensive survey on sign language translation that discusses state-of-the-art research from multi-disciplinary perspectives. Springer Science and Business Media Deutschland GmbH 2021 Article PeerReviewed Farooq, Uzma and Mohd. Rahim, Mohd. Shafry and Sabir, Nabeel and Hussain, Amir and Abid, Adnan (2021) Advances in machine translation for sign language: approaches, limitations, and challenges. Neural Computing and Applications, 33 (21). pp. 14357-14399. ISSN 0941-0643 http://dx.doi.org/10.1007/s00521-021-06079-3 |
| spellingShingle | QA75 Electronic computers. Computer science Farooq, Uzma Mohd. Rahim, Mohd. Shafry Sabir, Nabeel Hussain, Amir Abid, Adnan Advances in machine translation for sign language: approaches, limitations, and challenges |
| title | Advances in machine translation for sign language: approaches, limitations, and challenges |
| title_full | Advances in machine translation for sign language: approaches, limitations, and challenges |
| title_fullStr | Advances in machine translation for sign language: approaches, limitations, and challenges |
| title_full_unstemmed | Advances in machine translation for sign language: approaches, limitations, and challenges |
| title_short | Advances in machine translation for sign language: approaches, limitations, and challenges |
| title_sort | advances in machine translation for sign language approaches limitations and challenges |
| topic | QA75 Electronic computers. Computer science |
| work_keys_str_mv | AT farooquzma advancesinmachinetranslationforsignlanguageapproacheslimitationsandchallenges AT mohdrahimmohdshafry advancesinmachinetranslationforsignlanguageapproacheslimitationsandchallenges AT sabirnabeel advancesinmachinetranslationforsignlanguageapproacheslimitationsandchallenges AT hussainamir advancesinmachinetranslationforsignlanguageapproacheslimitationsandchallenges AT abidadnan advancesinmachinetranslationforsignlanguageapproacheslimitationsandchallenges |