Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion
We perform gesture recognition in a Virtual Reality (VR) environment using data produced by the Leap Motion device. Leap Motion generates a virtual three-dimensional (3D) hand model by recognizing and tracking user‘s hands. From this model, the Leap Motion application programming interface...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/9/3/445 |
| _version_ | 1811192964081254400 |
|---|---|
| author | Aurelijus Vaitkevičius Mantas Taroza Tomas Blažauskas Robertas Damaševičius Rytis Maskeliūnas Marcin Woźniak |
| author_facet | Aurelijus Vaitkevičius Mantas Taroza Tomas Blažauskas Robertas Damaševičius Rytis Maskeliūnas Marcin Woźniak |
| author_sort | Aurelijus Vaitkevičius |
| collection | DOAJ |
| description | We perform gesture recognition in a Virtual Reality (VR) environment using data produced by the Leap Motion device. Leap Motion generates a virtual three-dimensional (3D) hand model by recognizing and tracking user‘s hands. From this model, the Leap Motion application programming interface (API) provides hand and finger locations in the 3D space. We present a system that is capable of learning gestures by using the data from the Leap Motion device and the Hidden Markov classification (HMC) algorithm. We have achieved the gesture recognition accuracy (mean ± SD) is 86.1 ± 8.2% and gesture typing speed is 3.09 ± 0.53 words per minute (WPM), when recognizing the gestures of the American Sign Language (ASL). |
| first_indexed | 2024-04-12T00:00:41Z |
| format | Article |
| id | doaj.art-6c64ffbe660f4db3bf25ad5f14dc0424 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-04-12T00:00:41Z |
| publishDate | 2019-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-6c64ffbe660f4db3bf25ad5f14dc04242022-12-22T03:56:14ZengMDPI AGApplied Sciences2076-34172019-01-019344510.3390/app9030445app9030445Recognition of American Sign Language Gestures in a Virtual Reality Using Leap MotionAurelijus Vaitkevičius0Mantas Taroza1Tomas Blažauskas2Robertas Damaševičius3Rytis Maskeliūnas4Marcin Woźniak5Department of Software Engineering, Kaunas University of Technology, 50186 Kaunas, LithuaniaDepartment of Software Engineering, Kaunas University of Technology, 50186 Kaunas, LithuaniaDepartment of Software Engineering, Kaunas University of Technology, 50186 Kaunas, LithuaniaDepartment of Software Engineering, Kaunas University of Technology, 50186 Kaunas, LithuaniaDepartment of Multimedia Engineering, Kaunas University of Technology, 50186 Kaunas, LithuaniaInstitute of Mathematics, Silesian University of Technology, 44-100 Gliwice, PolandWe perform gesture recognition in a Virtual Reality (VR) environment using data produced by the Leap Motion device. Leap Motion generates a virtual three-dimensional (3D) hand model by recognizing and tracking user‘s hands. From this model, the Leap Motion application programming interface (API) provides hand and finger locations in the 3D space. We present a system that is capable of learning gestures by using the data from the Leap Motion device and the Hidden Markov classification (HMC) algorithm. We have achieved the gesture recognition accuracy (mean ± SD) is 86.1 ± 8.2% and gesture typing speed is 3.09 ± 0.53 words per minute (WPM), when recognizing the gestures of the American Sign Language (ASL).https://www.mdpi.com/2076-3417/9/3/445gesture recognitionmachine learningdata miningpattern recognitionvirtual realityleap motion |
| spellingShingle | Aurelijus Vaitkevičius Mantas Taroza Tomas Blažauskas Robertas Damaševičius Rytis Maskeliūnas Marcin Woźniak Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion Applied Sciences gesture recognition machine learning data mining pattern recognition virtual reality leap motion |
| title | Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion |
| title_full | Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion |
| title_fullStr | Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion |
| title_full_unstemmed | Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion |
| title_short | Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion |
| title_sort | recognition of american sign language gestures in a virtual reality using leap motion |
| topic | gesture recognition machine learning data mining pattern recognition virtual reality leap motion |
| url | https://www.mdpi.com/2076-3417/9/3/445 |
| work_keys_str_mv | AT aurelijusvaitkevicius recognitionofamericansignlanguagegesturesinavirtualrealityusingleapmotion AT mantastaroza recognitionofamericansignlanguagegesturesinavirtualrealityusingleapmotion AT tomasblazauskas recognitionofamericansignlanguagegesturesinavirtualrealityusingleapmotion AT robertasdamasevicius recognitionofamericansignlanguagegesturesinavirtualrealityusingleapmotion AT rytismaskeliunas recognitionofamericansignlanguagegesturesinavirtualrealityusingleapmotion AT marcinwozniak recognitionofamericansignlanguagegesturesinavirtualrealityusingleapmotion |