Statistical modeling and analysis of audio-visual association in speech
Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, February 2005.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2006
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/30182 |
| _version_ | 1811089830431424512 |
|---|---|
| author | Siracusa, Michael Richard, 1980- |
| author2 | Trevor Darrell and John W. Fisher. |
| author_facet | Trevor Darrell and John W. Fisher. Siracusa, Michael Richard, 1980- |
| author_sort | Siracusa, Michael Richard, 1980- |
| collection | MIT |
| description | Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, February 2005. |
| first_indexed | 2024-09-23T14:24:57Z |
| format | Thesis |
| id | mit-1721.1/30182 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T14:24:57Z |
| publishDate | 2006 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/301822019-04-11T03:32:43Z Statistical modeling and analysis of audio-visual association in speech Siracusa, Michael Richard, 1980- Trevor Darrell and John W. Fisher. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, February 2005. Includes bibliographical references (p. 183-186). Currently, most dialog systems are restricted to single user environments. This thesis aims to promote an un-tethered multi-person dialog system by exploring approaches to help solve the speech correspondence problem (i.e. who, if anyone, is currently speaking). We adopt a statistical framework in which this problem is put in the form of a hypothesis test and focus on the subtask of discriminating between associated and non-associated audio-visual observations. Various methods for modeling our audio-visual observations and ways of carrying out this test are studied and their relative performance is compared. We discuss issues that arise from the inherently high dimensional nature of audio-visual data and address these issues by exploring different techniques for finding low-dimensional informative subspaces in which we can perform our hypothesis tests. We study our ability to learn a person-specific as well as a generic model for measuring audio-visual association and evaluate performance oil multiple subjects taken from MIT's AVTIMIT database. by Michael Richard Siracusa. S.M. 2006-03-24T18:27:20Z 2006-03-24T18:27:20Z 2004 2005 Thesis http://hdl.handle.net/1721.1/30182 60679852 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 186 p. 8400105 bytes 8423575 bytes application/pdf application/pdf application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Siracusa, Michael Richard, 1980- Statistical modeling and analysis of audio-visual association in speech |
| title | Statistical modeling and analysis of audio-visual association in speech |
| title_full | Statistical modeling and analysis of audio-visual association in speech |
| title_fullStr | Statistical modeling and analysis of audio-visual association in speech |
| title_full_unstemmed | Statistical modeling and analysis of audio-visual association in speech |
| title_short | Statistical modeling and analysis of audio-visual association in speech |
| title_sort | statistical modeling and analysis of audio visual association in speech |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/30182 |
| work_keys_str_mv | AT siracusamichaelrichard1980 statisticalmodelingandanalysisofaudiovisualassociationinspeech |