Combined Hand Gesture — Speech Model for Human Action Recognition
This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and spee...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2013-12-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/13/12/17098 |
| _version_ | 1828112988823879680 |
|---|---|
| author | Sheng-Tzong Cheng Chih-Wei Hsu Jian-Pan Li |
| author_facet | Sheng-Tzong Cheng Chih-Wei Hsu Jian-Pan Li |
| author_sort | Sheng-Tzong Cheng |
| collection | DOAJ |
| description | This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions. |
| first_indexed | 2024-04-11T11:59:22Z |
| format | Article |
| id | doaj.art-3208a154d5114621a659148c046665cd |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-11T11:59:22Z |
| publishDate | 2013-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-3208a154d5114621a659148c046665cd2022-12-22T04:24:57ZengMDPI AGSensors1424-82202013-12-011312170981712910.3390/s131217098s131217098Combined Hand Gesture — Speech Model for Human Action RecognitionSheng-Tzong Cheng0Chih-Wei Hsu1Jian-Pan Li2Department of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, TaiwanDepartment of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, TaiwanDepartment of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, TaiwanThis study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions.http://www.mdpi.com/1424-8220/13/12/17098hand gesture detectionhand gesture recognitionspeech recognitionhuman behavior |
| spellingShingle | Sheng-Tzong Cheng Chih-Wei Hsu Jian-Pan Li Combined Hand Gesture — Speech Model for Human Action Recognition Sensors hand gesture detection hand gesture recognition speech recognition human behavior |
| title | Combined Hand Gesture — Speech Model for Human Action Recognition |
| title_full | Combined Hand Gesture — Speech Model for Human Action Recognition |
| title_fullStr | Combined Hand Gesture — Speech Model for Human Action Recognition |
| title_full_unstemmed | Combined Hand Gesture — Speech Model for Human Action Recognition |
| title_short | Combined Hand Gesture — Speech Model for Human Action Recognition |
| title_sort | combined hand gesture speech model for human action recognition |
| topic | hand gesture detection hand gesture recognition speech recognition human behavior |
| url | http://www.mdpi.com/1424-8220/13/12/17098 |
| work_keys_str_mv | AT shengtzongcheng combinedhandgesturespeechmodelforhumanactionrecognition AT chihweihsu combinedhandgesturespeechmodelforhumanactionrecognition AT jianpanli combinedhandgesturespeechmodelforhumanactionrecognition |