Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
Recognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imager...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-06-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/20/12/3496 |
_version_ | 1797564576665960448 |
---|---|
author | Jiacan Xu Hao Zheng Jianhui Wang Donglin Li Xiaoke Fang |
author_facet | Jiacan Xu Hao Zheng Jianhui Wang Donglin Li Xiaoke Fang |
author_sort | Jiacan Xu |
collection | DOAJ |
description | Recognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imagery task using deep learning, but if the important features related to motor imagery are ignored, it may lead to a decline in the recognition performance of the algorithm. This paper proposes a new deep multi-view feature learning method for the classification task of motor imagery electroencephalogram (EEG) signals. In order to obtain more representative motor imagery features in EEG signals, we introduced a multi-view feature representation based on the characteristics of EEG signals and the differences between different features. Different feature extraction methods were used to respectively extract the time domain, frequency domain, time-frequency domain and spatial features of EEG signals, so as to made them cooperate and complement. Then, the deep restricted Boltzmann machine (RBM) network improved by t-distributed stochastic neighbor embedding(t-SNE) was adopted to learn the multi-view features of EEG signals, so that the algorithm removed the feature redundancy while took into account the global characteristics in the multi-view feature sequence, reduced the dimension of the multi-visual features and enhanced the recognizability of the features. Finally, support vector machine (SVM) was chosen to classify deep multi-view features. Applying our proposed method to the BCI competition IV 2a dataset we obtained excellent classification results. The results show that the deep multi-view feature learning method further improved the classification accuracy of motor imagery tasks. |
first_indexed | 2024-03-10T18:59:07Z |
format | Article |
id | doaj.art-47e4bd6cfa4f44029987005748b764c1 |
institution | Directory Open Access Journal |
issn | 1424-8220 |
language | English |
last_indexed | 2024-03-10T18:59:07Z |
publishDate | 2020-06-01 |
publisher | MDPI AG |
record_format | Article |
series | Sensors |
spelling | doaj.art-47e4bd6cfa4f44029987005748b764c12023-11-20T04:30:05ZengMDPI AGSensors1424-82202020-06-012012349610.3390/s20123496Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature LearningJiacan Xu0Hao Zheng1Jianhui Wang2Donglin Li3Xiaoke Fang4School of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaSchool of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, ChinaSchool of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaSchool of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaSchool of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaRecognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imagery task using deep learning, but if the important features related to motor imagery are ignored, it may lead to a decline in the recognition performance of the algorithm. This paper proposes a new deep multi-view feature learning method for the classification task of motor imagery electroencephalogram (EEG) signals. In order to obtain more representative motor imagery features in EEG signals, we introduced a multi-view feature representation based on the characteristics of EEG signals and the differences between different features. Different feature extraction methods were used to respectively extract the time domain, frequency domain, time-frequency domain and spatial features of EEG signals, so as to made them cooperate and complement. Then, the deep restricted Boltzmann machine (RBM) network improved by t-distributed stochastic neighbor embedding(t-SNE) was adopted to learn the multi-view features of EEG signals, so that the algorithm removed the feature redundancy while took into account the global characteristics in the multi-view feature sequence, reduced the dimension of the multi-visual features and enhanced the recognizability of the features. Finally, support vector machine (SVM) was chosen to classify deep multi-view features. Applying our proposed method to the BCI competition IV 2a dataset we obtained excellent classification results. The results show that the deep multi-view feature learning method further improved the classification accuracy of motor imagery tasks.https://www.mdpi.com/1424-8220/20/12/3496brain-computer interface (BCI)electroencephalography (EEG)multi-view learningdeep neural networkparametric t-distributed stochastic neighbor embedding (p.t-SNE) |
spellingShingle | Jiacan Xu Hao Zheng Jianhui Wang Donglin Li Xiaoke Fang Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning Sensors brain-computer interface (BCI) electroencephalography (EEG) multi-view learning deep neural network parametric t-distributed stochastic neighbor embedding (p.t-SNE) |
title | Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning |
title_full | Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning |
title_fullStr | Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning |
title_full_unstemmed | Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning |
title_short | Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning |
title_sort | recognition of eeg signal motor imagery intention based on deep multi view feature learning |
topic | brain-computer interface (BCI) electroencephalography (EEG) multi-view learning deep neural network parametric t-distributed stochastic neighbor embedding (p.t-SNE) |
url | https://www.mdpi.com/1424-8220/20/12/3496 |
work_keys_str_mv | AT jiacanxu recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning AT haozheng recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning AT jianhuiwang recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning AT donglinli recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning AT xiaokefang recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning |