Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning
Electroencephalogram (EEG) data are produced in quantity for measuring brain activity in response to external stimuli. With the rapid development of brain-inspired intelligence, spiking neural network (SNN) possesses the potential to handle EEG data by using spiking activity transmitted among spatia...
| Main Authors: | , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/172866 |
| _version_ | 1811676926404722688 |
|---|---|
| author | Wu, Xuanyu Feng, Yixiong Lou, Shanhe Zheng, Hao Hu, Bingtao Hong, Zhaoxi Tan, Jianrong |
| author2 | School of Mechanical and Aerospace Engineering |
| author_facet | School of Mechanical and Aerospace Engineering Wu, Xuanyu Feng, Yixiong Lou, Shanhe Zheng, Hao Hu, Bingtao Hong, Zhaoxi Tan, Jianrong |
| author_sort | Wu, Xuanyu |
| collection | NTU |
| description | Electroencephalogram (EEG) data are produced in quantity for measuring brain activity in response to external stimuli. With the rapid development of brain-inspired intelligence, spiking neural network (SNN) possesses the potential to handle EEG data by using spiking activity transmitted among spatially located synapses and neurons. As an original and unifying SNN architecture, NeuCube, is developed to model, recognize and understand EEG data. However, the NeuCube still faces some challenges for EEG-based pattern recognition, such as few labeled data and changes of data probability distribution. Hence, this paper proposes a novel method to improve the performance of the NeuCube for EEG-based pattern recognition by transfer learning. In the first place, the covariance matrix alignment of EEG data is implemented for every subject in the Euclidean space, which reduces the probability distribution discrepancy of EEG data between different subjects. Different estimation methods for reference covariance matrix are tested and the optimal one is selected for different subjects. Secondly, spatio-temporal features of EEG data are extracted based on the NeuCube reservoir. Since hyper-parameters of the NeuCube reservoir have a great impact on its spatio-temporal representation, an improved cuckoo search algorithm is proposed to discover the optimal hyper-parameters for obtaining the optimal spatio-temporal features. Last but not least, a weighted transfer support vector machine is proposed to improve the original output classifier of the NeuCube in order to make the model adaptive to the cross-domain variability of EEG data. The proposed method is tested on open dataset 2a from BCI competition IV 2008 and achieves good spatio-temporal pattern recognition results. Furthermore, the neuron connectivity and activation level associated with the process of mental tasks are illustrated. |
| first_indexed | 2024-10-01T02:29:14Z |
| format | Journal Article |
| id | ntu-10356/172866 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T02:29:14Z |
| publishDate | 2023 |
| record_format | dspace |
| spelling | ntu-10356/1728662023-12-27T04:17:36Z Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning Wu, Xuanyu Feng, Yixiong Lou, Shanhe Zheng, Hao Hu, Bingtao Hong, Zhaoxi Tan, Jianrong School of Mechanical and Aerospace Engineering Engineering::Mechanical engineering NeuCube Spiking Neural Networks Electroencephalogram (EEG) data are produced in quantity for measuring brain activity in response to external stimuli. With the rapid development of brain-inspired intelligence, spiking neural network (SNN) possesses the potential to handle EEG data by using spiking activity transmitted among spatially located synapses and neurons. As an original and unifying SNN architecture, NeuCube, is developed to model, recognize and understand EEG data. However, the NeuCube still faces some challenges for EEG-based pattern recognition, such as few labeled data and changes of data probability distribution. Hence, this paper proposes a novel method to improve the performance of the NeuCube for EEG-based pattern recognition by transfer learning. In the first place, the covariance matrix alignment of EEG data is implemented for every subject in the Euclidean space, which reduces the probability distribution discrepancy of EEG data between different subjects. Different estimation methods for reference covariance matrix are tested and the optimal one is selected for different subjects. Secondly, spatio-temporal features of EEG data are extracted based on the NeuCube reservoir. Since hyper-parameters of the NeuCube reservoir have a great impact on its spatio-temporal representation, an improved cuckoo search algorithm is proposed to discover the optimal hyper-parameters for obtaining the optimal spatio-temporal features. Last but not least, a weighted transfer support vector machine is proposed to improve the original output classifier of the NeuCube in order to make the model adaptive to the cross-domain variability of EEG data. The proposed method is tested on open dataset 2a from BCI competition IV 2008 and achieves good spatio-temporal pattern recognition results. Furthermore, the neuron connectivity and activation level associated with the process of mental tasks are illustrated. This work was supported by the National Natural Science Foundation of China (Grant Nos. 52130501, 52105281 and 52205288) and the Key Research and Development Program of Zhejiang Province (Grant Nos. 2023C01214). 2023-12-27T04:17:36Z 2023-12-27T04:17:36Z 2023 Journal Article Wu, X., Feng, Y., Lou, S., Zheng, H., Hu, B., Hong, Z. & Tan, J. (2023). Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning. Neurocomputing, 529, 222-235. https://dx.doi.org/10.1016/j.neucom.2023.01.087 0925-2312 https://hdl.handle.net/10356/172866 10.1016/j.neucom.2023.01.087 2-s2.0-85148007311 529 222 235 en Neurocomputing © 2023 Elsevier B.V. All rights reserved. |
| spellingShingle | Engineering::Mechanical engineering NeuCube Spiking Neural Networks Wu, Xuanyu Feng, Yixiong Lou, Shanhe Zheng, Hao Hu, Bingtao Hong, Zhaoxi Tan, Jianrong Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning |
| title | Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning |
| title_full | Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning |
| title_fullStr | Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning |
| title_full_unstemmed | Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning |
| title_short | Improving NeuCube spiking neural network for EEG-based pattern recognition using transfer learning |
| title_sort | improving neucube spiking neural network for eeg based pattern recognition using transfer learning |
| topic | Engineering::Mechanical engineering NeuCube Spiking Neural Networks |
| url | https://hdl.handle.net/10356/172866 |
| work_keys_str_mv | AT wuxuanyu improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning AT fengyixiong improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning AT loushanhe improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning AT zhenghao improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning AT hubingtao improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning AT hongzhaoxi improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning AT tanjianrong improvingneucubespikingneuralnetworkforeegbasedpatternrecognitionusingtransferlearning |