A sign language smart phone based on realistic animation
Mobile phones are now popular in current society for its portability and intelligence, but excluded from life of the hearing-impaired because sounds are unavailable for them. This paper provides a framework of speech based Chinese Sign Language (CSL) Animation System on Smart Phones, which combines...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2018-01-01
|
| Series: | MATEC Web of Conferences |
| Online Access: | https://doi.org/10.1051/matecconf/201818903024 |
| _version_ | 1818615990996434944 |
|---|---|
| author | Wang Wentong Zhang Wenhui Sun Bin |
| author_facet | Wang Wentong Zhang Wenhui Sun Bin |
| author_sort | Wang Wentong |
| collection | DOAJ |
| description | Mobile phones are now popular in current society for its portability and intelligence, but excluded from life of the hearing-impaired because sounds are unavailable for them. This paper provides a framework of speech based Chinese Sign Language (CSL) Animation System on Smart Phones, which combines speech recognition and sign language animation to make phones convenient for the hearing-impaired. This paper recognizes the Chinese speech into text first, and then proposes a HMMSVM model to judge interrogative expression from the speech and rewrites the plain text as mark-up text according to the rules of Chinese Sign Language Mark-up Language (CSLML) which provides signs for recording expressive context in the text, the corresponding animation is finally synthesized using key-frame technology. The prototype system based on the framework provided in this paper gives plausible Sign Language animation. |
| first_indexed | 2024-12-16T16:42:41Z |
| format | Article |
| id | doaj.art-5abd0ab409cc4651abe8f14915e2e16c |
| institution | Directory Open Access Journal |
| issn | 2261-236X |
| language | English |
| last_indexed | 2024-12-16T16:42:41Z |
| publishDate | 2018-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | MATEC Web of Conferences |
| spelling | doaj.art-5abd0ab409cc4651abe8f14915e2e16c2022-12-21T22:24:16ZengEDP SciencesMATEC Web of Conferences2261-236X2018-01-011890302410.1051/matecconf/201818903024matecconf_meamt2018_03024A sign language smart phone based on realistic animationWang WentongZhang WenhuiSun BinMobile phones are now popular in current society for its portability and intelligence, but excluded from life of the hearing-impaired because sounds are unavailable for them. This paper provides a framework of speech based Chinese Sign Language (CSL) Animation System on Smart Phones, which combines speech recognition and sign language animation to make phones convenient for the hearing-impaired. This paper recognizes the Chinese speech into text first, and then proposes a HMMSVM model to judge interrogative expression from the speech and rewrites the plain text as mark-up text according to the rules of Chinese Sign Language Mark-up Language (CSLML) which provides signs for recording expressive context in the text, the corresponding animation is finally synthesized using key-frame technology. The prototype system based on the framework provided in this paper gives plausible Sign Language animation.https://doi.org/10.1051/matecconf/201818903024 |
| spellingShingle | Wang Wentong Zhang Wenhui Sun Bin A sign language smart phone based on realistic animation MATEC Web of Conferences |
| title | A sign language smart phone based on realistic animation |
| title_full | A sign language smart phone based on realistic animation |
| title_fullStr | A sign language smart phone based on realistic animation |
| title_full_unstemmed | A sign language smart phone based on realistic animation |
| title_short | A sign language smart phone based on realistic animation |
| title_sort | sign language smart phone based on realistic animation |
| url | https://doi.org/10.1051/matecconf/201818903024 |
| work_keys_str_mv | AT wangwentong asignlanguagesmartphonebasedonrealisticanimation AT zhangwenhui asignlanguagesmartphonebasedonrealisticanimation AT sunbin asignlanguagesmartphonebasedonrealisticanimation AT wangwentong signlanguagesmartphonebasedonrealisticanimation AT zhangwenhui signlanguagesmartphonebasedonrealisticanimation AT sunbin signlanguagesmartphonebasedonrealisticanimation |