Training hierarchical networks for function approximation
Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2018
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/113159 |
| _version_ | 1826212987781775360 |
|---|---|
| author | Miranda, Brando, M. Eng. Massachusetts Institute of Technology |
| author2 | Tomaso Poggio. |
| author_facet | Tomaso Poggio. Miranda, Brando, M. Eng. Massachusetts Institute of Technology |
| author_sort | Miranda, Brando, M. Eng. Massachusetts Institute of Technology |
| collection | MIT |
| description | Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016. |
| first_indexed | 2024-09-23T15:41:19Z |
| format | Thesis |
| id | mit-1721.1/113159 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T15:41:19Z |
| publishDate | 2018 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1131592019-04-11T08:51:49Z Training hierarchical networks for function approximation Miranda, Brando, M. Eng. Massachusetts Institute of Technology Tomaso Poggio. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis: M. Eng., Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2016. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (pages 59-60). In this work we investigate function approximation using Hierarchical Networks. We start of by investigating the theory proposed by Poggio et al [2] that Deep Learning Convolutional Neural Networks (DCN) can be equivalent to hierarchical kernel machines with the Radial Basis Functions (RBF).We investigate the difficulty of training RBF networks with stochastic gradient descent (SGD) and hierarchical RBF. We discovered that training singled layered RBF networks can be quite simple with a good initialization and good choice of standard deviation for the Gaussian. Training hierarchical RBFs remains as an open question, however, we clearly identified the issue surrounding training hierarchical RBFs and potential methods to resolve this. We also compare standard DCN networks to hierarchical Radial Basis Functions in tasks that has not been explored yet; the role of depth in learning compositional functions. by Brando Miranda. M. Eng. 2018-01-12T21:00:43Z 2018-01-12T21:00:43Z 2016 2016 Thesis http://hdl.handle.net/1721.1/113159 1018308740 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 60 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Miranda, Brando, M. Eng. Massachusetts Institute of Technology Training hierarchical networks for function approximation |
| title | Training hierarchical networks for function approximation |
| title_full | Training hierarchical networks for function approximation |
| title_fullStr | Training hierarchical networks for function approximation |
| title_full_unstemmed | Training hierarchical networks for function approximation |
| title_short | Training hierarchical networks for function approximation |
| title_sort | training hierarchical networks for function approximation |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/113159 |
| work_keys_str_mv | AT mirandabrandomengmassachusettsinstituteoftechnology traininghierarchicalnetworksforfunctionapproximation |