Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning

Recognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imager...

Full description

Bibliographic Details
Main Authors: Jiacan Xu, Hao Zheng, Jianhui Wang, Donglin Li, Xiaoke Fang
Format: Article
Language:English
Published: MDPI AG 2020-06-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/12/3496
_version_ 1797564576665960448
author Jiacan Xu
Hao Zheng
Jianhui Wang
Donglin Li
Xiaoke Fang
author_facet Jiacan Xu
Hao Zheng
Jianhui Wang
Donglin Li
Xiaoke Fang
author_sort Jiacan Xu
collection DOAJ
description Recognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imagery task using deep learning, but if the important features related to motor imagery are ignored, it may lead to a decline in the recognition performance of the algorithm. This paper proposes a new deep multi-view feature learning method for the classification task of motor imagery electroencephalogram (EEG) signals. In order to obtain more representative motor imagery features in EEG signals, we introduced a multi-view feature representation based on the characteristics of EEG signals and the differences between different features. Different feature extraction methods were used to respectively extract the time domain, frequency domain, time-frequency domain and spatial features of EEG signals, so as to made them cooperate and complement. Then, the deep restricted Boltzmann machine (RBM) network improved by t-distributed stochastic neighbor embedding(t-SNE) was adopted to learn the multi-view features of EEG signals, so that the algorithm removed the feature redundancy while took into account the global characteristics in the multi-view feature sequence, reduced the dimension of the multi-visual features and enhanced the recognizability of the features. Finally, support vector machine (SVM) was chosen to classify deep multi-view features. Applying our proposed method to the BCI competition IV 2a dataset we obtained excellent classification results. The results show that the deep multi-view feature learning method further improved the classification accuracy of motor imagery tasks.
first_indexed 2024-03-10T18:59:07Z
format Article
id doaj.art-47e4bd6cfa4f44029987005748b764c1
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T18:59:07Z
publishDate 2020-06-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-47e4bd6cfa4f44029987005748b764c12023-11-20T04:30:05ZengMDPI AGSensors1424-82202020-06-012012349610.3390/s20123496Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature LearningJiacan Xu0Hao Zheng1Jianhui Wang2Donglin Li3Xiaoke Fang4School of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaSchool of Information Science and Engineering, Shenyang University of Technology, Shenyang 110870, ChinaSchool of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaSchool of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaSchool of Information Science and Engineering, Northeastern University, Shenyang 110819, ChinaRecognition of motor imagery intention is one of the hot current research focuses of brain-computer interface (BCI) studies. It can help patients with physical dyskinesia to convey their movement intentions. In recent years, breakthroughs have been made in the research on recognition of motor imagery task using deep learning, but if the important features related to motor imagery are ignored, it may lead to a decline in the recognition performance of the algorithm. This paper proposes a new deep multi-view feature learning method for the classification task of motor imagery electroencephalogram (EEG) signals. In order to obtain more representative motor imagery features in EEG signals, we introduced a multi-view feature representation based on the characteristics of EEG signals and the differences between different features. Different feature extraction methods were used to respectively extract the time domain, frequency domain, time-frequency domain and spatial features of EEG signals, so as to made them cooperate and complement. Then, the deep restricted Boltzmann machine (RBM) network improved by t-distributed stochastic neighbor embedding(t-SNE) was adopted to learn the multi-view features of EEG signals, so that the algorithm removed the feature redundancy while took into account the global characteristics in the multi-view feature sequence, reduced the dimension of the multi-visual features and enhanced the recognizability of the features. Finally, support vector machine (SVM) was chosen to classify deep multi-view features. Applying our proposed method to the BCI competition IV 2a dataset we obtained excellent classification results. The results show that the deep multi-view feature learning method further improved the classification accuracy of motor imagery tasks.https://www.mdpi.com/1424-8220/20/12/3496brain-computer interface (BCI)electroencephalography (EEG)multi-view learningdeep neural networkparametric t-distributed stochastic neighbor embedding (p.t-SNE)
spellingShingle Jiacan Xu
Hao Zheng
Jianhui Wang
Donglin Li
Xiaoke Fang
Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
Sensors
brain-computer interface (BCI)
electroencephalography (EEG)
multi-view learning
deep neural network
parametric t-distributed stochastic neighbor embedding (p.t-SNE)
title Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
title_full Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
title_fullStr Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
title_full_unstemmed Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
title_short Recognition of EEG Signal Motor Imagery Intention Based on Deep Multi-View Feature Learning
title_sort recognition of eeg signal motor imagery intention based on deep multi view feature learning
topic brain-computer interface (BCI)
electroencephalography (EEG)
multi-view learning
deep neural network
parametric t-distributed stochastic neighbor embedding (p.t-SNE)
url https://www.mdpi.com/1424-8220/20/12/3496
work_keys_str_mv AT jiacanxu recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning
AT haozheng recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning
AT jianhuiwang recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning
AT donglinli recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning
AT xiaokefang recognitionofeegsignalmotorimageryintentionbasedondeepmultiviewfeaturelearning