Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model
In electroencephalograph (EEG) emotion recognition research, obtaining high-level emotional features with more discriminative information has become the key to improving the classification performance. This study proposes a new end-to-end emotion recognition method based on brain connectivity (BC) f...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-06-01
|
| Series: | Frontiers in Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnins.2022.878146/full |
| _version_ | 1818249496302190592 |
|---|---|
| author | Jingxia Chen Chongdan Min Changhao Wang Zhezhe Tang Yang Liu Xiuwen Hu |
| author_facet | Jingxia Chen Chongdan Min Changhao Wang Zhezhe Tang Yang Liu Xiuwen Hu |
| author_sort | Jingxia Chen |
| collection | DOAJ |
| description | In electroencephalograph (EEG) emotion recognition research, obtaining high-level emotional features with more discriminative information has become the key to improving the classification performance. This study proposes a new end-to-end emotion recognition method based on brain connectivity (BC) features and domain adaptive residual convolutional network (short for BC-DA-RCNN), which could effectively extract the spatial connectivity information related to the emotional state of the human brain and introduce domain adaptation to achieve accurate emotion recognition within and across the subject’s EEG signals. The BC information is represented by the global brain network connectivity matrix. The DA-RCNN is used to extract high-level emotional features between different dimensions of EEG signals, reduce the domain offset between different subjects, and strengthen the common features between different subjects. The experimental results on the large public DEAP data set show that the accuracy of the subject-dependent and subject-independent binary emotion classification in valence reaches 95.15 and 88.28%, respectively, which outperforms all the benchmark methods. The proposed method is proven to have lower complexity, better generalization ability, and domain robustness that help to lay a solid foundation for the development of high-performance affective brain-computer interface applications. |
| first_indexed | 2024-12-12T15:37:25Z |
| format | Article |
| id | doaj.art-66e23f94c6d740e6bb0948ae35c2d81c |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-12-12T15:37:25Z |
| publishDate | 2022-06-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-66e23f94c6d740e6bb0948ae35c2d81c2022-12-22T00:19:59ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2022-06-011610.3389/fnins.2022.878146878146Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution ModelJingxia ChenChongdan MinChanghao WangZhezhe TangYang LiuXiuwen HuIn electroencephalograph (EEG) emotion recognition research, obtaining high-level emotional features with more discriminative information has become the key to improving the classification performance. This study proposes a new end-to-end emotion recognition method based on brain connectivity (BC) features and domain adaptive residual convolutional network (short for BC-DA-RCNN), which could effectively extract the spatial connectivity information related to the emotional state of the human brain and introduce domain adaptation to achieve accurate emotion recognition within and across the subject’s EEG signals. The BC information is represented by the global brain network connectivity matrix. The DA-RCNN is used to extract high-level emotional features between different dimensions of EEG signals, reduce the domain offset between different subjects, and strengthen the common features between different subjects. The experimental results on the large public DEAP data set show that the accuracy of the subject-dependent and subject-independent binary emotion classification in valence reaches 95.15 and 88.28%, respectively, which outperforms all the benchmark methods. The proposed method is proven to have lower complexity, better generalization ability, and domain robustness that help to lay a solid foundation for the development of high-performance affective brain-computer interface applications.https://www.frontiersin.org/articles/10.3389/fnins.2022.878146/fullEEGbrain connectivityresidual convolutiondomain adaptativeemotion recognition |
| spellingShingle | Jingxia Chen Chongdan Min Changhao Wang Zhezhe Tang Yang Liu Xiuwen Hu Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model Frontiers in Neuroscience EEG brain connectivity residual convolution domain adaptative emotion recognition |
| title | Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model |
| title_full | Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model |
| title_fullStr | Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model |
| title_full_unstemmed | Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model |
| title_short | Electroencephalograph-Based Emotion Recognition Using Brain Connectivity Feature and Domain Adaptive Residual Convolution Model |
| title_sort | electroencephalograph based emotion recognition using brain connectivity feature and domain adaptive residual convolution model |
| topic | EEG brain connectivity residual convolution domain adaptative emotion recognition |
| url | https://www.frontiersin.org/articles/10.3389/fnins.2022.878146/full |
| work_keys_str_mv | AT jingxiachen electroencephalographbasedemotionrecognitionusingbrainconnectivityfeatureanddomainadaptiveresidualconvolutionmodel AT chongdanmin electroencephalographbasedemotionrecognitionusingbrainconnectivityfeatureanddomainadaptiveresidualconvolutionmodel AT changhaowang electroencephalographbasedemotionrecognitionusingbrainconnectivityfeatureanddomainadaptiveresidualconvolutionmodel AT zhezhetang electroencephalographbasedemotionrecognitionusingbrainconnectivityfeatureanddomainadaptiveresidualconvolutionmodel AT yangliu electroencephalographbasedemotionrecognitionusingbrainconnectivityfeatureanddomainadaptiveresidualconvolutionmodel AT xiuwenhu electroencephalographbasedemotionrecognitionusingbrainconnectivityfeatureanddomainadaptiveresidualconvolutionmodel |