Masking important information to assess the robustness of a multimodal classifier for emotion recognition

Deep neural networks have been proven effective in classifying human interactions into emotions, especially by encoding multiple input modalities. In this work, we assess the robustness of a transformer-based multimodal audio-text classifier for emotion recognition, by perturbing the input at infere...

Full description

Bibliographic Details
Main Authors: Dror Cohen, Ido Rosenberger, Moshe Butman, Kfir Bar
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-03-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2023.1091443/full