Multimodal Emotion Recognition from Art Using Sequential Co-Attention
In this study, we present a multimodal emotion recognition architecture that uses both feature-level attention (sequential co-attention) and modality attention (weighted modality fusion) to classify emotion in art. The proposed architecture helps the model to focus on learning informative and refine...
Main Authors: | Tsegaye Misikir Tashu, Sakina Hajiyeva, Tomas Horvath |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-08-01
|
Series: | Journal of Imaging |
Subjects: | |
Online Access: | https://www.mdpi.com/2313-433X/7/8/157 |
Similar Items
-
Multimodal Attention Network for Continuous-Time Emotion Recognition Using Video and EEG Signals
by: Dong Yoon Choi, et al.
Published: (2020-01-01) -
Robust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion
by: Baijun Xie, et al.
Published: (2021-07-01) -
Multimodal transformer augmented fusion for speech emotion recognition
by: Yuanyuan Wang, et al.
Published: (2023-05-01) -
TACFN: Transformer-Based Adaptive Cross-Modal Fusion Network for Multimodal Emotion Recognition
by: Feng Liu, et al.
Published: (2023-12-01) -
A Framework to Evaluate Fusion Methods for Multimodal Emotion Recognition
by: Diego Pena, et al.
Published: (2023-01-01)