Kinect-based automatic sign language recognition
As technology advances, so does its popularity as a teaching tool, and it can be envisioned that technology will play an integral role in education in the future. This project aims to integrate the use of technology with sign-language to help improve and promote communication not only amongst the he...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
2016
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/10356/66915 |
| _version_ | 1811687597868580864 |
|---|---|
| author | Lin, Zi Ying |
| author2 | Cham Tat Jen |
| author_facet | Cham Tat Jen Lin, Zi Ying |
| author_sort | Lin, Zi Ying |
| collection | NTU |
| description | As technology advances, so does its popularity as a teaching tool, and it can be envisioned that technology will play an integral role in education in the future. This project aims to integrate the use of technology with sign-language to help improve and promote communication not only amongst the hearing-impaired, but also with their friends and family as well. The project works on using the functionality of the depth sensor on the Microsoft Kinect to recognize gestures according to the American Sign Language (ASL).
The project is a prototype that demonstrates the concept of learning with technology by allowing users to practice the ASL hand gestures through an educational game. The depth sensor in the Microsoft Kinect allows the project to detect and identify the hand and 5 individual fingers. The concept of gesture recognition is essential to future developments of this project and serves a basis, as this project scratches only the surface of the potential of this concept. This report details the process of development of this project, the detection of the hand and fingers, as well as the recognition of gestures. |
| first_indexed | 2024-10-01T05:18:51Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/66915 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:18:51Z |
| publishDate | 2016 |
| record_format | dspace |
| spelling | ntu-10356/669152023-03-03T20:31:19Z Kinect-based automatic sign language recognition Lin, Zi Ying Cham Tat Jen School of Computer Engineering DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision As technology advances, so does its popularity as a teaching tool, and it can be envisioned that technology will play an integral role in education in the future. This project aims to integrate the use of technology with sign-language to help improve and promote communication not only amongst the hearing-impaired, but also with their friends and family as well. The project works on using the functionality of the depth sensor on the Microsoft Kinect to recognize gestures according to the American Sign Language (ASL). The project is a prototype that demonstrates the concept of learning with technology by allowing users to practice the ASL hand gestures through an educational game. The depth sensor in the Microsoft Kinect allows the project to detect and identify the hand and 5 individual fingers. The concept of gesture recognition is essential to future developments of this project and serves a basis, as this project scratches only the surface of the potential of this concept. This report details the process of development of this project, the detection of the hand and fingers, as well as the recognition of gestures. Bachelor of Engineering (Computer Science) 2016-05-04T08:16:28Z 2016-05-04T08:16:28Z 2016 Final Year Project (FYP) http://hdl.handle.net/10356/66915 en Nanyang Technological University 39 p. application/pdf |
| spellingShingle | DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Lin, Zi Ying Kinect-based automatic sign language recognition |
| title | Kinect-based automatic sign language recognition |
| title_full | Kinect-based automatic sign language recognition |
| title_fullStr | Kinect-based automatic sign language recognition |
| title_full_unstemmed | Kinect-based automatic sign language recognition |
| title_short | Kinect-based automatic sign language recognition |
| title_sort | kinect based automatic sign language recognition |
| topic | DRNTU::Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision |
| url | http://hdl.handle.net/10356/66915 |
| work_keys_str_mv | AT linziying kinectbasedautomaticsignlanguagerecognition |