Emotion Recognition by Correlating Facial Expressions and EEG Analysis
Emotion recognition is a fundamental task that any affective computing system must perform to adapt to the user’s current mood. The analysis of electroencephalography signals has gained notoriety in studying human emotions because of its non-invasive nature. This paper presents a two-stage deep lear...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-07-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/15/6987 |
| _version_ | 1797525808057679872 |
|---|---|
| author | Adrian R. Aguiñaga Daniel E. Hernandez Angeles Quezada Andrés Calvillo Téllez |
| author_facet | Adrian R. Aguiñaga Daniel E. Hernandez Angeles Quezada Andrés Calvillo Téllez |
| author_sort | Adrian R. Aguiñaga |
| collection | DOAJ |
| description | Emotion recognition is a fundamental task that any affective computing system must perform to adapt to the user’s current mood. The analysis of electroencephalography signals has gained notoriety in studying human emotions because of its non-invasive nature. This paper presents a two-stage deep learning model to recognize emotional states by correlating facial expressions and brain signals. Most of the works related to the analysis of emotional states are based on analyzing large segments of signals, generally as long as the evoked potential lasts, which could cause many other phenomena to be involved in the recognition process. Unlike with other phenomena, such as epilepsy, there is no clearly defined marker of when an event begins or ends. The novelty of the proposed model resides in the use of facial expressions as markers to improve the recognition process. This work uses a facial emotion recognition technique (FER) to create identifiers each time an emotional response is detected and uses them to extract segments of electroencephalography (EEG) records that a priori will be considered relevant for the analysis. The proposed model was tested on the DEAP dataset. |
| first_indexed | 2024-03-10T09:19:12Z |
| format | Article |
| id | doaj.art-cbd14660ff694c9d990570fede666c47 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T09:19:12Z |
| publishDate | 2021-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-cbd14660ff694c9d990570fede666c472023-11-22T05:22:41ZengMDPI AGApplied Sciences2076-34172021-07-011115698710.3390/app11156987Emotion Recognition by Correlating Facial Expressions and EEG AnalysisAdrian R. Aguiñaga0Daniel E. Hernandez1Angeles Quezada2Andrés Calvillo Téllez3Tecnológico Nacional de México Campus Tijuana, Tijuana 22414, MexicoTecnológico Nacional de México Campus Tijuana, Tijuana 22414, MexicoTecnológico Nacional de México Campus Tijuana, Tijuana 22414, MexicoInstituto Politécnico Nacional, Tijuana 22435, MexicoEmotion recognition is a fundamental task that any affective computing system must perform to adapt to the user’s current mood. The analysis of electroencephalography signals has gained notoriety in studying human emotions because of its non-invasive nature. This paper presents a two-stage deep learning model to recognize emotional states by correlating facial expressions and brain signals. Most of the works related to the analysis of emotional states are based on analyzing large segments of signals, generally as long as the evoked potential lasts, which could cause many other phenomena to be involved in the recognition process. Unlike with other phenomena, such as epilepsy, there is no clearly defined marker of when an event begins or ends. The novelty of the proposed model resides in the use of facial expressions as markers to improve the recognition process. This work uses a facial emotion recognition technique (FER) to create identifiers each time an emotional response is detected and uses them to extract segments of electroencephalography (EEG) records that a priori will be considered relevant for the analysis. The proposed model was tested on the DEAP dataset.https://www.mdpi.com/2076-3417/11/15/6987affective computingEEGemotionsFERmachine learningneural networks |
| spellingShingle | Adrian R. Aguiñaga Daniel E. Hernandez Angeles Quezada Andrés Calvillo Téllez Emotion Recognition by Correlating Facial Expressions and EEG Analysis Applied Sciences affective computing EEG emotions FER machine learning neural networks |
| title | Emotion Recognition by Correlating Facial Expressions and EEG Analysis |
| title_full | Emotion Recognition by Correlating Facial Expressions and EEG Analysis |
| title_fullStr | Emotion Recognition by Correlating Facial Expressions and EEG Analysis |
| title_full_unstemmed | Emotion Recognition by Correlating Facial Expressions and EEG Analysis |
| title_short | Emotion Recognition by Correlating Facial Expressions and EEG Analysis |
| title_sort | emotion recognition by correlating facial expressions and eeg analysis |
| topic | affective computing EEG emotions FER machine learning neural networks |
| url | https://www.mdpi.com/2076-3417/11/15/6987 |
| work_keys_str_mv | AT adrianraguinaga emotionrecognitionbycorrelatingfacialexpressionsandeeganalysis AT danielehernandez emotionrecognitionbycorrelatingfacialexpressionsandeeganalysis AT angelesquezada emotionrecognitionbycorrelatingfacialexpressionsandeeganalysis AT andrescalvillotellez emotionrecognitionbycorrelatingfacialexpressionsandeeganalysis |