Attention-based 3D convolutional recurrent neural network model for multimodal emotion recognition

Attention-based 3D convolutional recurrent neural network model for multimodal emotion recognition

IntroductionMultimodal emotion recognition has become a hot topic in human-computer interaction and intelligent healthcare fields. However, combining information from different human different modalities for emotion computation is still challenging.MethodsIn this paper, we propose a three-dimensiona...

Full description

Bibliographic Details
Main Authors:	Yiming Du, Penghai Li, Longlong Cheng, Xuanwei Zhang, Mingji Li, Fengzhou Li
Format:	Article
Language:	English
Published:	Frontiers Media S.A. 2024-01-01
Series:	Frontiers in Neuroscience
Subjects:	electroencephalogram (EEG) emotion recognition attention mechanism convolutional neural network (CNN) 3D feature construction module multimodal recognition
Online Access:	https://www.frontiersin.org/articles/10.3389/fnins.2023.1330077/full

Similar Items

Multimodal EEG Emotion Recognition Based on the Attention Recurrent Graph Convolutional Network
by: Jingxia Chen, et al.
Published: (2022-11-01)

Electroencephalogram signals emotion recognition based on convolutional neural network-recurrent neural network framework with channel-temporal attention mechanism for older adults
by: Lei Jiang, et al.
Published: (2022-09-01)

Multimodal Attention Network for Continuous-Time Emotion Recognition Using Video and EEG Signals
by: Dong Yoon Choi, et al.
Published: (2020-01-01)

Electroencephalogram based face emotion recognition using multimodal fusion and 1-D convolution neural network (ID-CNN) classifier
by: Youseef Alotaibi, et al.
Published: (2023-07-01)

Music emotion recognition based on temporal convolutional attention network using EEG
by: Yinghao Qiao, et al.
Published: (2024-03-01)

Emotion recognition model based on CLSTM and channel attention mechanism
by: Chen Yuxia, et al.
Published: (2022-01-01)

CIT-EmotionNet: convolution interactive transformer network for EEG emotion recognition
by: Wei Lu, et al.
Published: (2024-12-01)

A novel feature fusion network for multimodal emotion recognition from EEG and eye movement signals
by: Baole Fu, et al.
Published: (2023-08-01)

Multimodal Emotion Detection via Attention-Based Fusion of Extracted Facial and Speech Features
by: Dilnoza Mamieva, et al.
Published: (2023-06-01)

Corrigendum: A novel feature fusion network for multimodal emotion recognition from EEG and eye movement signals
by: Baole Fu, et al.
Published: (2023-09-01)

MACNet: A Multidimensional Attention-Based Convolutional Neural Network for Lower-Limb Motor Imagery Classification
by: Ling-Long Li, et al.
Published: (2024-11-01)

Multimodal Emotion Recognition Using a Hierarchical Fusion Convolutional Neural Network
by: Yong Zhang, et al.
Published: (2021-01-01)

Multimodal Emotion Recognition Based on Facial Expressions, Speech, and EEG
by: Jiahui Pan, et al.
Published: (2024-01-01)

Multi-Scale Attention 3D Convolutional Network for Multimodal Gesture Recognition
by: Huizhou Chen, et al.
Published: (2022-03-01)

EEG-Based Emotion Recognition Using Convolutional Recurrent Neural Network with Multi-Head Self-Attention
by: Zhangfang Hu, et al.
Published: (2022-11-01)

E-MFNN: an emotion-multimodal fusion neural network framework for emotion recognition
by: Zhuen Guo, et al.
Published: (2024-04-01)

Multimodal Emotion Recognition From EEG Signals and Facial Expressions
by: Shuai Wang, et al.
Published: (2023-01-01)

Cascaded Convolutional Recurrent Neural Networks for EEG Emotion Recognition Based on Temporal–Frequency–Spatial Features
by: Yuan Luo, et al.
Published: (2023-06-01)

Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion
by: Yucel Cimtay, et al.
Published: (2020-01-01)

Facial Expression Recognition Using Convolutional Neural Network with Attention Module
by: Habib Bahari Khoirullah, et al.
Published: (2022-12-01)

Multimodal Emotion Recognition and Sentiment Analysis Using Masked Attention and Multimodal Interaction
by: Tatiana Voloshina, et al.
Published: (2023-05-01)

Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images
by: El mehdi Cherrat, et al.
Published: (2020-01-01)

Enhancing Multimodal Emotion Recognition through Attention Mechanisms in BERT and CNN Architectures
by: Fazliddin Makhmudov, et al.
Published: (2024-05-01)

Identifying relevant EEG channels for subject-independent emotion recognition using attention network layers
by: Camilo E. Valderrama, et al.
Published: (2025-02-01)

A Pre-Activation Residual Convolutional Network With Attention Modules for High-Resolution Segmented EEG Emotion Recognition
by: Ioannis Charalampous, et al.
Published: (2025-01-01)

EEG–fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network
by: Guijun Chen, et al.
Published: (2024-08-01)

DSRP: A Database for Stress Reduction Using Physiological Signals
by: Zhengping Li, et al.
Published: (2024-01-01)

Enhancing Cross-Language Multimodal Emotion Recognition With Dual Attention Transformers
by: Syed Aun Muhammad Zaidi, et al.
Published: (2024-01-01)

Improvement of Multimodal Emotion Recognition Based on Temporal-Aware Bi-Direction Multi-Scale Network and Multi-Head Attention Mechanisms
by: Yuezhou Wu, et al.
Published: (2024-04-01)

Robust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion
by: Baijun Xie, et al.
Published: (2021-07-01)

EEG Emotion Recognition Model Based on Attention and GAN
by: Wenxuan Qiao, et al.
Published: (2024-01-01)

Emotion recognition based on multimodal physiological electrical signals
by: Zhuozheng Wang, et al.
Published: (2025-03-01)

Recognizing Emotions Evoked by Music Using CNN-LSTM Networks on EEG Signals
by: Sobhan Sheykhivand, et al.
Published: (2020-01-01)

Multimodal Emotion Recognition Based on EEG and EOG Signals Evoked by the Video-Odor Stimuli
by: Minchao Wu, et al.
Published: (2024-01-01)

Convolutional Block Attention Module–Multimodal Feature-Fusion Action Recognition: Enabling Miner Unsafe Action Recognition
by: Yu Wang, et al.
Published: (2024-07-01)

MultiModal Emotional Recognition by Artificial Intelligence and its Application in Psychology
by: Seyed Sadegh Hosseini, et al.
Published: (2024-10-01)

CATM: A Multi-Feature-Based Cross-Scale Attentional Convolutional EEG Emotion Recognition Model
by: Hongde Yu, et al.
Published: (2024-07-01)

CNN-Based Multimodal Human Recognition in Surveillance Environments
by: Ja Hyung Koo, et al.
Published: (2018-09-01)

Hybrid LSTM–Attention and CNN Model for Enhanced Speech Emotion Recognition
by: Fazliddin Makhmudov, et al.
Published: (2024-12-01)

Multimodal Emotion Recognition Fusion Analysis Adapting BERT With Heterogeneous Feature Unification
by: Sanghyun Lee, et al.
Published: (2021-01-01)