Exploring neural network architectures for acoustic modeling
Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2018
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/113981 |
| _version_ | 1826200183358095360 |
|---|---|
| author | Zhang, Yu, Ph. D. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author2 | James R. Glass. |
| author_facet | James R. Glass. Zhang, Yu, Ph. D. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author_sort | Zhang, Yu, Ph. D. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| collection | MIT |
| description | Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017. |
| first_indexed | 2024-09-23T11:32:26Z |
| format | Thesis |
| id | mit-1721.1/113981 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T11:32:26Z |
| publishDate | 2018 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1139812019-04-12T07:40:19Z Exploring neural network architectures for acoustic modeling Zhang, Yu, Ph. D. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science James R. Glass. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: Ph. D., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2017. Cataloged from PDF version of thesis. Includes bibliographical references (pages 121-132). Deep neural network (DNN)-based acoustic models (AMs) have significantly improved automatic speech recognition (ASR) on many tasks. However, ASR performance still suffers from speaker and environment variability, especially under low-resource, distant microphone, noisy, and reverberant conditions. The goal of this thesis is to explore novel neural architectures that can effectively improve ASR performance. In the first part of the thesis, we present a well-engineered, efficient open-source framework to enable the creation of arbitrary neural networks for speech recognition. We first design essential components to simplify the creation of a neural network with recurrent loops. Next, we propose several algorithms to speed up neural network training based on this framework. We demonstrate the flexibility and scalability of the toolkit across different benchmarks. In the second part of the thesis, we propose several new neural models to reduce ASR word error rates (WERs) using the toolkit we created. First, we formulate a new neural architecture loosely inspired by humans to process low-resource languages. Second, we demonstrate a way to enable very deep neural network models by adding more non-linearities and expressive power while keeping the model optimizable and generalizable. Experimental results demonstrate that our approach outperforms several ASR baselines and model variants, yielding a 10% relative WER gain. Third, we incorporate these techniques into an end-to-end recognition model. We experiment with the Wall Street Journal ASR task and achieve 10.5% WER without any dictionary or language model, an 8.5% absolute improvement over the best published result. by Yu Zhang. Ph. D. 2018-03-02T22:21:35Z 2018-03-02T22:21:35Z 2017 2017 Thesis http://hdl.handle.net/1721.1/113981 1023628488 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 132 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Zhang, Yu, Ph. D. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Exploring neural network architectures for acoustic modeling |
| title | Exploring neural network architectures for acoustic modeling |
| title_full | Exploring neural network architectures for acoustic modeling |
| title_fullStr | Exploring neural network architectures for acoustic modeling |
| title_full_unstemmed | Exploring neural network architectures for acoustic modeling |
| title_short | Exploring neural network architectures for acoustic modeling |
| title_sort | exploring neural network architectures for acoustic modeling |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/113981 |
| work_keys_str_mv | AT zhangyuphdmassachusettsinstituteoftechnologydepartmentofelectricalengineeringandcomputerscience exploringneuralnetworkarchitecturesforacousticmodeling |