Understanding Neural Networks from Theoretical and Biological Perspectives
Neural Networks is an important subject of both biological and artificial intelligence, which we have not yet fully understand. Recently the field of neural networks has been popularized by the advancement of Deep Learning, and people start to know how to make artificial neural networks perform extr...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2024
|
| Online Access: | https://hdl.handle.net/1721.1/153904 |
| _version_ | 1826198553559564288 |
|---|---|
| author | Liao, Qianli |
| author2 | Poggio, Tomaso A. |
| author_facet | Poggio, Tomaso A. Liao, Qianli |
| author_sort | Liao, Qianli |
| collection | MIT |
| description | Neural Networks is an important subject of both biological and artificial intelligence, which we have not yet fully understand. Recently the field of neural networks has been popularized by the advancement of Deep Learning, and people start to know how to make artificial neural networks perform extrordinarily well in practical applications, rivaling human performance in many tasks. However, the extreme pursuits of practical performances are not underpinned by deep understanding, leading to an unbalanced and incomplete, if not precarious, field of intelligence.
Our theoretical and biological understanding about neural networks have fallen far behind their unprecedented proliferation. This creates an awkward situation — we create very capable intelligent systems that we do not understand, compromising our ability to predict, control and correctly treat such systems. Furthermore, these developments also do not directly translate to our understanding of the general concept of intelligence, including, most importantly, our own human intelligence.
With alleviating such issues as one of our goals, my colleagues and I spent a few years on trying to understand neural networks from both theoretical and biological perspectives, gaining interesting insights and results on these topics. This led to a few published papers that I compile to constitute my thesis. Finally, I discuss my preferred future directions of research under the current trends of AI/AGI. |
| first_indexed | 2024-09-23T11:06:41Z |
| format | Thesis |
| id | mit-1721.1/153904 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T11:06:41Z |
| publishDate | 2024 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1539042024-03-22T03:47:48Z Understanding Neural Networks from Theoretical and Biological Perspectives Liao, Qianli Poggio, Tomaso A. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Neural Networks is an important subject of both biological and artificial intelligence, which we have not yet fully understand. Recently the field of neural networks has been popularized by the advancement of Deep Learning, and people start to know how to make artificial neural networks perform extrordinarily well in practical applications, rivaling human performance in many tasks. However, the extreme pursuits of practical performances are not underpinned by deep understanding, leading to an unbalanced and incomplete, if not precarious, field of intelligence. Our theoretical and biological understanding about neural networks have fallen far behind their unprecedented proliferation. This creates an awkward situation — we create very capable intelligent systems that we do not understand, compromising our ability to predict, control and correctly treat such systems. Furthermore, these developments also do not directly translate to our understanding of the general concept of intelligence, including, most importantly, our own human intelligence. With alleviating such issues as one of our goals, my colleagues and I spent a few years on trying to understand neural networks from both theoretical and biological perspectives, gaining interesting insights and results on these topics. This led to a few published papers that I compile to constitute my thesis. Finally, I discuss my preferred future directions of research under the current trends of AI/AGI. Ph.D. 2024-03-21T19:14:51Z 2024-03-21T19:14:51Z 2024-02 2024-02-21T17:18:51.859Z Thesis https://hdl.handle.net/1721.1/153904 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Liao, Qianli Understanding Neural Networks from Theoretical and Biological Perspectives |
| title | Understanding Neural Networks from Theoretical and Biological Perspectives |
| title_full | Understanding Neural Networks from Theoretical and Biological Perspectives |
| title_fullStr | Understanding Neural Networks from Theoretical and Biological Perspectives |
| title_full_unstemmed | Understanding Neural Networks from Theoretical and Biological Perspectives |
| title_short | Understanding Neural Networks from Theoretical and Biological Perspectives |
| title_sort | understanding neural networks from theoretical and biological perspectives |
| url | https://hdl.handle.net/1721.1/153904 |
| work_keys_str_mv | AT liaoqianli understandingneuralnetworksfromtheoreticalandbiologicalperspectives |