Discovering linguistic structures in speech : models and applications
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2015
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/93065 |
| _version_ | 1826194166045999104 |
|---|---|
| author | Lee, Chia-ying (Chia-ying Jackie) |
| author2 | James R. Glass. |
| author_facet | James R. Glass. Lee, Chia-ying (Chia-ying Jackie) |
| author_sort | Lee, Chia-ying (Chia-ying Jackie) |
| collection | MIT |
| description | Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014. |
| first_indexed | 2024-09-23T09:51:57Z |
| format | Thesis |
| id | mit-1721.1/93065 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T09:51:57Z |
| publishDate | 2015 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/930652019-04-12T20:25:14Z Discovering linguistic structures in speech : models and applications Lee, Chia-ying (Chia-ying Jackie) James R. Glass. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2014. Cataloged from PDF version of thesis. Includes bibliographical references (pages 169-188). The ability to infer linguistic structures from noisy speech streams seems to be an innate human capability. However, reproducing the same ability in machines has remained a challenging task. In this thesis, we address this task, and develop a class of probabilistic models that discover the latent linguistic structures of a language directly from acoustic signals. In particular, we explore a nonparametric Bayesian framework for automatically acquiring a phone-like inventory of a language. In addition, we integrate our phone discovery model with adaptor grammars, a nonparametric Bayesian extension of probabilistic context-free grammars, to induce hierarchical linguistic structures, including sub-word and word-like units, directly from speech signals. When tested on a variety of speech corpora containing different acoustic conditions, domains, and languages, these models consistently demonstrate an ability to learn highly meaningful linguistic structures. In addition to learning sub-word and word-like units, we apply these models to the problem of one-shot learning tasks for spoken words, and our results confirm the importance of inducing intrinsic speech structures for learning spoken words from just one or a few examples. We also show that by leveraging the linguistic units our models discover, we can automatically infer the hidden coding scheme between the written and spoken forms of a language from a transcribed speech corpus. Learning such a coding scheme enables us to develop a completely data-driven approach to creating a pronunciation dictionary for the basis of phone-based speech recognition. This approach contrasts sharply with the typical method of creating such a dictionary by human experts, which can be a time-consuming and expensive endeavor. Our experiments show that automatically derived lexicons allow us to build speech recognizers that consistently perform closely to supervised speech recognizers, which should enable more rapid development of speech recognition capability for low-resource languages. by Chia-ying (Jackie) Lee. Ph. D. 2015-01-20T17:59:24Z 2015-01-20T17:59:24Z 2014 2014 Thesis http://hdl.handle.net/1721.1/93065 900000825 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 188 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Lee, Chia-ying (Chia-ying Jackie) Discovering linguistic structures in speech : models and applications |
| title | Discovering linguistic structures in speech : models and applications |
| title_full | Discovering linguistic structures in speech : models and applications |
| title_fullStr | Discovering linguistic structures in speech : models and applications |
| title_full_unstemmed | Discovering linguistic structures in speech : models and applications |
| title_short | Discovering linguistic structures in speech : models and applications |
| title_sort | discovering linguistic structures in speech models and applications |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/93065 |
| work_keys_str_mv | AT leechiayingchiayingjackie discoveringlinguisticstructuresinspeechmodelsandapplications |