Modeling continuous visual speech using boosted viseme models

In this paper, a novel connected-viseme approach for modeling continuous visual speech is presented. The approach adopts AdaBoost-HMMs as the viseme models. Continuous visual speech is modeled by connecting the viseme models using level building algorithm. The approach is applied to identify words...

Full description

Bibliographic Details
Main Authors: Dong, Liang, Foo, Say Wei, Yong, Lian
Other Authors: School of Electrical and Electronic Engineering
Format: Conference Paper
Language:English
Published: 2009
Subjects:
Online Access:https://hdl.handle.net/10356/91029
http://hdl.handle.net/10220/6002
_version_ 1826115395183968256
author Dong, Liang
Foo, Say Wei
Yong, Lian
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Dong, Liang
Foo, Say Wei
Yong, Lian
author_sort Dong, Liang
collection NTU
description In this paper, a novel connected-viseme approach for modeling continuous visual speech is presented. The approach adopts AdaBoost-HMMs as the viseme models. Continuous visual speech is modeled by connecting the viseme models using level building algorithm. The approach is applied to identify words and phrases in visual speech. The recognition results indicate that the proposed method has better performance than the conventional approach.
first_indexed 2024-10-01T03:54:26Z
format Conference Paper
id ntu-10356/91029
institution Nanyang Technological University
language English
last_indexed 2024-10-01T03:54:26Z
publishDate 2009
record_format dspace
spelling ntu-10356/910292020-03-07T13:24:46Z Modeling continuous visual speech using boosted viseme models Dong, Liang Foo, Say Wei Yong, Lian School of Electrical and Electronic Engineering International Conference on Information, Communications and Signal Processing (4th : 2003 : Singapore) IEEE Pacific Rim Conference on Multimedia (4th : 2003 : Singapore) DRNTU::Engineering::Electrical and electronic engineering::Electronic systems In this paper, a novel connected-viseme approach for modeling continuous visual speech is presented. The approach adopts AdaBoost-HMMs as the viseme models. Continuous visual speech is modeled by connecting the viseme models using level building algorithm. The approach is applied to identify words and phrases in visual speech. The recognition results indicate that the proposed method has better performance than the conventional approach. Accepted version 2009-08-03T03:43:47Z 2019-12-06T17:58:27Z 2009-08-03T03:43:47Z 2019-12-06T17:58:27Z 2003 2003 Conference Paper Dong, L., Foo, S. W., & Lian, Y. (2003). Modeling continuous visual speech using boosted viseme models. Proeedings of the 4th International Conference on Information, Communications and Signal Processing and the 4th IEEE Pacific-Rim Conference on Multimedia. Vol.3.(pp. 1394-1398). Singapore: IEEE. https://hdl.handle.net/10356/91029 http://hdl.handle.net/10220/6002 10.1109/ICICS.2003.1292694 en International Conference on Information, Communications and Signal Processing and IEEE Pacific-Rim Conference on Multimedia © 2003 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder. http://www.ieee.org/portal/site. 5 p. application/pdf
spellingShingle DRNTU::Engineering::Electrical and electronic engineering::Electronic systems
Dong, Liang
Foo, Say Wei
Yong, Lian
Modeling continuous visual speech using boosted viseme models
title Modeling continuous visual speech using boosted viseme models
title_full Modeling continuous visual speech using boosted viseme models
title_fullStr Modeling continuous visual speech using boosted viseme models
title_full_unstemmed Modeling continuous visual speech using boosted viseme models
title_short Modeling continuous visual speech using boosted viseme models
title_sort modeling continuous visual speech using boosted viseme models
topic DRNTU::Engineering::Electrical and electronic engineering::Electronic systems
url https://hdl.handle.net/10356/91029
http://hdl.handle.net/10220/6002
work_keys_str_mv AT dongliang modelingcontinuousvisualspeechusingboostedvisememodels
AT foosaywei modelingcontinuousvisualspeechusingboostedvisememodels
AT yonglian modelingcontinuousvisualspeechusingboostedvisememodels