A simpler and faster biological learning framework for increasing robustness
Hebbian Learning has been proposed for many years. The advantage of Hebbian learning is more plausible compared with Backpropagation in the aspect of biological learning. In this work, a new Hebbian Learning Framework (HLF) is designed. From the experiment results, the proposed HLF is much simpler a...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis-Master by Coursework |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/154676 |
| _version_ | 1811682008137465856 |
|---|---|
| author | Wang, Maosen |
| author2 | Ponnuthurai Nagaratnam Suganthan |
| author_facet | Ponnuthurai Nagaratnam Suganthan Wang, Maosen |
| author_sort | Wang, Maosen |
| collection | NTU |
| description | Hebbian Learning has been proposed for many years. The advantage of Hebbian learning is more plausible compared with Backpropagation in the aspect of biological learning. In this work, a new Hebbian Learning Framework (HLF) is designed. From the experiment results, the proposed HLF is much simpler and faster than the state-of-the-art Hebbian learning method. In this case, it can promote the usage scenarios of Hebbian Learning.
Robustness of learning algorithms remains an important problem to be solved from both the perspective of adversarial attacks and improving generalization. Another work of this dissertation is that we investigate the robustness of the proposed HLF in depth. We find that Hebbian learning based algorithms outperform conventional learning algorithms like CNNs by a huge margin of upto 18% on the CIFAR-10 dataset under the addition of adversarial noise. We highlight that an important reason for this is the underlying representations that are being learned by the learning algorithms. |
| first_indexed | 2024-10-01T03:50:00Z |
| format | Thesis-Master by Coursework |
| id | ntu-10356/154676 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:50:00Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1546762023-07-04T16:40:20Z A simpler and faster biological learning framework for increasing robustness Wang, Maosen Ponnuthurai Nagaratnam Suganthan School of Electrical and Electronic Engineering EPNSugan@ntu.edu.sg Engineering::Electrical and electronic engineering Hebbian Learning has been proposed for many years. The advantage of Hebbian learning is more plausible compared with Backpropagation in the aspect of biological learning. In this work, a new Hebbian Learning Framework (HLF) is designed. From the experiment results, the proposed HLF is much simpler and faster than the state-of-the-art Hebbian learning method. In this case, it can promote the usage scenarios of Hebbian Learning. Robustness of learning algorithms remains an important problem to be solved from both the perspective of adversarial attacks and improving generalization. Another work of this dissertation is that we investigate the robustness of the proposed HLF in depth. We find that Hebbian learning based algorithms outperform conventional learning algorithms like CNNs by a huge margin of upto 18% on the CIFAR-10 dataset under the addition of adversarial noise. We highlight that an important reason for this is the underlying representations that are being learned by the learning algorithms. Master of Science (Computer Control and Automation) 2022-01-03T08:17:12Z 2022-01-03T08:17:12Z 2021 Thesis-Master by Coursework Wang, M. (2021). A simpler and faster biological learning framework for increasing robustness. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/154676 https://hdl.handle.net/10356/154676 en application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Electrical and electronic engineering Wang, Maosen A simpler and faster biological learning framework for increasing robustness |
| title | A simpler and faster biological learning framework for increasing robustness |
| title_full | A simpler and faster biological learning framework for increasing robustness |
| title_fullStr | A simpler and faster biological learning framework for increasing robustness |
| title_full_unstemmed | A simpler and faster biological learning framework for increasing robustness |
| title_short | A simpler and faster biological learning framework for increasing robustness |
| title_sort | simpler and faster biological learning framework for increasing robustness |
| topic | Engineering::Electrical and electronic engineering |
| url | https://hdl.handle.net/10356/154676 |
| work_keys_str_mv | AT wangmaosen asimplerandfasterbiologicallearningframeworkforincreasingrobustness AT wangmaosen simplerandfasterbiologicallearningframeworkforincreasingrobustness |