Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks
Due to energy efficiency, spiking neural networks (SNNs) have gradually been considered as an alternative to convolutional neural networks (CNNs) in various machine learning tasks. In image recognition tasks, leveraging the superior capability of CNNs, the CNN–SNN conversion is considered one of the...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-06-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/12/11/5749 |
| _version_ | 1797494005534031872 |
|---|---|
| author | Huynh Cong Viet Ngu Keon Myung Lee |
| author_facet | Huynh Cong Viet Ngu Keon Myung Lee |
| author_sort | Huynh Cong Viet Ngu |
| collection | DOAJ |
| description | Due to energy efficiency, spiking neural networks (SNNs) have gradually been considered as an alternative to convolutional neural networks (CNNs) in various machine learning tasks. In image recognition tasks, leveraging the superior capability of CNNs, the CNN–SNN conversion is considered one of the most successful approaches to training SNNs. However, previous works assume a rather long inference time period called inference latency to be allowed, while having a trade-off between inference latency and accuracy. One of the main reasons for this phenomenon stems from the difficulty in determining proper a firing threshold for spiking neurons. The threshold determination procedure is called a threshold balancing technique in the CNN–SNN conversion approach. This paper proposes a CNN–SNN conversion method with a new threshold balancing technique that obtains converted SNN models with good accuracy even with low latency. The proposed method organizes the SNN models with soft-reset IF spiking neurons. The threshold balancing technique estimates the thresholds for spiking neurons based on the maximum input current in a layerwise and channelwise manner. The experiment results have shown that our converted SNN models attain even higher accuracy than the corresponding trained CNN model for the MNIST dataset with low latency. In addition, for the Fashion-MNIST and CIFAR-10 datasets, our converted SNNs have shown less conversion loss than other methods in low latencies. The proposed method can be beneficial in deploying efficient SNN models for recognition tasks on resource-limited systems because the inference latency is strongly associated with energy consumption. |
| first_indexed | 2024-03-10T01:28:05Z |
| format | Article |
| id | doaj.art-c5d1e2963c66449e8afbf1547ffc7768 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T01:28:05Z |
| publishDate | 2022-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-c5d1e2963c66449e8afbf1547ffc77682023-11-23T13:47:15ZengMDPI AGApplied Sciences2076-34172022-06-011211574910.3390/app12115749Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition TasksHuynh Cong Viet Ngu0Keon Myung Lee1Department of Computer Science, Chungbuk National University, Cheongju 28644, KoreaDepartment of Computer Science, Chungbuk National University, Cheongju 28644, KoreaDue to energy efficiency, spiking neural networks (SNNs) have gradually been considered as an alternative to convolutional neural networks (CNNs) in various machine learning tasks. In image recognition tasks, leveraging the superior capability of CNNs, the CNN–SNN conversion is considered one of the most successful approaches to training SNNs. However, previous works assume a rather long inference time period called inference latency to be allowed, while having a trade-off between inference latency and accuracy. One of the main reasons for this phenomenon stems from the difficulty in determining proper a firing threshold for spiking neurons. The threshold determination procedure is called a threshold balancing technique in the CNN–SNN conversion approach. This paper proposes a CNN–SNN conversion method with a new threshold balancing technique that obtains converted SNN models with good accuracy even with low latency. The proposed method organizes the SNN models with soft-reset IF spiking neurons. The threshold balancing technique estimates the thresholds for spiking neurons based on the maximum input current in a layerwise and channelwise manner. The experiment results have shown that our converted SNN models attain even higher accuracy than the corresponding trained CNN model for the MNIST dataset with low latency. In addition, for the Fashion-MNIST and CIFAR-10 datasets, our converted SNNs have shown less conversion loss than other methods in low latencies. The proposed method can be beneficial in deploying efficient SNN models for recognition tasks on resource-limited systems because the inference latency is strongly associated with energy consumption.https://www.mdpi.com/2076-3417/12/11/5749CNN–SNN conversionspiking neural networkintelligent mobile applicationsthreshold balancing techniqueimage recognition taskmachine learning |
| spellingShingle | Huynh Cong Viet Ngu Keon Myung Lee Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks Applied Sciences CNN–SNN conversion spiking neural network intelligent mobile applications threshold balancing technique image recognition task machine learning |
| title | Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks |
| title_full | Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks |
| title_fullStr | Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks |
| title_full_unstemmed | Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks |
| title_short | Effective Conversion of a Convolutional Neural Network into a Spiking Neural Network for Image Recognition Tasks |
| title_sort | effective conversion of a convolutional neural network into a spiking neural network for image recognition tasks |
| topic | CNN–SNN conversion spiking neural network intelligent mobile applications threshold balancing technique image recognition task machine learning |
| url | https://www.mdpi.com/2076-3417/12/11/5749 |
| work_keys_str_mv | AT huynhcongvietngu effectiveconversionofaconvolutionalneuralnetworkintoaspikingneuralnetworkforimagerecognitiontasks AT keonmyunglee effectiveconversionofaconvolutionalneuralnetworkintoaspikingneuralnetworkforimagerecognitiontasks |