HF-SNN: High-Frequency Spiking Neural Network
As the third generation of neural networks, spiking neural network (SNN) motivated by neurophysiology enjoys considerable advances due to integrating different information, such as time and space. The frequency-domain provides a powerful capability of modeling and training convolutional neural netwo...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9383297/ |
| _version_ | 1819320137943089152 |
|---|---|
| author | Jing Su Jing Li |
| author_facet | Jing Su Jing Li |
| author_sort | Jing Su |
| collection | DOAJ |
| description | As the third generation of neural networks, spiking neural network (SNN) motivated by neurophysiology enjoys considerable advances due to integrating different information, such as time and space. The frequency-domain provides a powerful capability of modeling and training convolutional neural networks (CNNs). However, SNN with binary input and output will lose much information and slightly inferior to deep neural networks (DNN). We consider how to make the most of information to protect input. Binary input and output are different from DNN, the essence of difference at frequency distribution. In this work, from the insight of frequency distribution, we rethink the SNN training process and give a novel method to transfer SNN to high-frequency spiking neural network (HF-SNN). This approach preserves considerably more information than other optimizing strategies and enables flexibility in the training process. Besides, we evaluate the HF-SNN with extensive experiments on three large datasets: CIFAR-10, CIFAR-100, and ImageNet. Finally, our model supports training a deeper SNN model from scratch and achieves better performance on these datasets than the existing SNN model. |
| first_indexed | 2024-12-24T11:14:48Z |
| format | Article |
| id | doaj.art-536fef80fb2d488b9754f3b43b833ff4 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-24T11:14:48Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-536fef80fb2d488b9754f3b43b833ff42022-12-21T16:58:25ZengIEEEIEEE Access2169-35362021-01-019519505195710.1109/ACCESS.2021.30681599383297HF-SNN: High-Frequency Spiking Neural NetworkJing Su0https://orcid.org/0000-0003-0572-9194Jing Li1https://orcid.org/0000-0001-9019-7449Department of Optical Science and Engineering, Shanghai Ultra-Precision Optical Manufacturing Engineering Center, Fudan University, Shanghai, ChinaDepartment of Optical Science and Engineering, Shanghai Ultra-Precision Optical Manufacturing Engineering Center, Fudan University, Shanghai, ChinaAs the third generation of neural networks, spiking neural network (SNN) motivated by neurophysiology enjoys considerable advances due to integrating different information, such as time and space. The frequency-domain provides a powerful capability of modeling and training convolutional neural networks (CNNs). However, SNN with binary input and output will lose much information and slightly inferior to deep neural networks (DNN). We consider how to make the most of information to protect input. Binary input and output are different from DNN, the essence of difference at frequency distribution. In this work, from the insight of frequency distribution, we rethink the SNN training process and give a novel method to transfer SNN to high-frequency spiking neural network (HF-SNN). This approach preserves considerably more information than other optimizing strategies and enables flexibility in the training process. Besides, we evaluate the HF-SNN with extensive experiments on three large datasets: CIFAR-10, CIFAR-100, and ImageNet. Finally, our model supports training a deeper SNN model from scratch and achieves better performance on these datasets than the existing SNN model.https://ieeexplore.ieee.org/document/9383297/Spiking neural networkhigh-frequencydeep learning |
| spellingShingle | Jing Su Jing Li HF-SNN: High-Frequency Spiking Neural Network IEEE Access Spiking neural network high-frequency deep learning |
| title | HF-SNN: High-Frequency Spiking Neural Network |
| title_full | HF-SNN: High-Frequency Spiking Neural Network |
| title_fullStr | HF-SNN: High-Frequency Spiking Neural Network |
| title_full_unstemmed | HF-SNN: High-Frequency Spiking Neural Network |
| title_short | HF-SNN: High-Frequency Spiking Neural Network |
| title_sort | hf snn high frequency spiking neural network |
| topic | Spiking neural network high-frequency deep learning |
| url | https://ieeexplore.ieee.org/document/9383297/ |
| work_keys_str_mv | AT jingsu hfsnnhighfrequencyspikingneuralnetwork AT jingli hfsnnhighfrequencyspikingneuralnetwork |