Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera
The automatic interpretation of human gestures can be used for a natural interaction with computers while getting rid of mechanical devices such as keyboards and mice. In order to achieve this objective, the recognition of hand postures has been studied for many years. However, most of the literatur...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2012-10-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/12/11/14416 |
| _version_ | 1797999458590392320 |
|---|---|
| author | Derek D. Lichti Hervé Lahamy |
| author_facet | Derek D. Lichti Hervé Lahamy |
| author_sort | Derek D. Lichti |
| collection | DOAJ |
| description | The automatic interpretation of human gestures can be used for a natural interaction with computers while getting rid of mechanical devices such as keyboards and mice. In order to achieve this objective, the recognition of hand postures has been studied for many years. However, most of the literature in this area has considered 2D images which cannot provide a full description of the hand gestures. In addition, a rotation-invariant identification remains an unsolved problem, even with the use of 2D images. The objective of the current study was to design a rotation-invariant recognition process while using a 3D signature for classifying hand postures. A heuristic and voxel-based signature has been designed and implemented. The tracking of the hand motion is achieved with the Kalman filter. A unique training image per posture is used in the supervised classification. The designed recognition process, the tracking procedure and the segmentation algorithm have been successfully evaluated. This study has demonstrated the efficiency of the proposed rotation invariant 3D hand posture signature which leads to 93.88% recognition rate after testing 14,732 samples of 12 postures taken from the alphabet of the American Sign Language. |
| first_indexed | 2024-04-11T11:04:57Z |
| format | Article |
| id | doaj.art-3b25002771f94b298b128c46c183c2a2 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-11T11:04:57Z |
| publishDate | 2012-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-3b25002771f94b298b128c46c183c2a22022-12-22T04:28:23ZengMDPI AGSensors1424-82202012-10-011211144161444110.3390/s121114416Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range CameraDerek D. LichtiHervé LahamyThe automatic interpretation of human gestures can be used for a natural interaction with computers while getting rid of mechanical devices such as keyboards and mice. In order to achieve this objective, the recognition of hand postures has been studied for many years. However, most of the literature in this area has considered 2D images which cannot provide a full description of the hand gestures. In addition, a rotation-invariant identification remains an unsolved problem, even with the use of 2D images. The objective of the current study was to design a rotation-invariant recognition process while using a 3D signature for classifying hand postures. A heuristic and voxel-based signature has been designed and implemented. The tracking of the hand motion is achieved with the Kalman filter. A unique training image per posture is used in the supervised classification. The designed recognition process, the tracking procedure and the segmentation algorithm have been successfully evaluated. This study has demonstrated the efficiency of the proposed rotation invariant 3D hand posture signature which leads to 93.88% recognition rate after testing 14,732 samples of 12 postures taken from the alphabet of the American Sign Language.http://www.mdpi.com/1424-8220/12/11/14416posture recognitionrange camerasegmentationtracking3D signaturerotation invarianceaccuracy assessment |
| spellingShingle | Derek D. Lichti Hervé Lahamy Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera Sensors posture recognition range camera segmentation tracking 3D signature rotation invariance accuracy assessment |
| title | Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera |
| title_full | Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera |
| title_fullStr | Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera |
| title_full_unstemmed | Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera |
| title_short | Towards Real-Time and Rotation-Invariant American Sign Language Alphabet Recognition Using a Range Camera |
| title_sort | towards real time and rotation invariant american sign language alphabet recognition using a range camera |
| topic | posture recognition range camera segmentation tracking 3D signature rotation invariance accuracy assessment |
| url | http://www.mdpi.com/1424-8220/12/11/14416 |
| work_keys_str_mv | AT derekdlichti towardsrealtimeandrotationinvariantamericansignlanguagealphabetrecognitionusingarangecamera AT hervelahamy towardsrealtimeandrotationinvariantamericansignlanguagealphabetrecognitionusingarangecamera |