Recognition of Emotion by Brain Connectivity and Eye Movement
Simultaneous activation of brain regions (i.e., brain connection features) is an essential mechanism of brain activity in emotion recognition of visual content. The occipital cortex of the brain is involved in visual processing, but the frontal lobe processes cranial nerve signals to control higher...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-09-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/18/6736 |
| _version_ | 1797482703827763200 |
|---|---|
| author | Jing Zhang Sung Park Ayoung Cho Mincheol Whang |
| author_facet | Jing Zhang Sung Park Ayoung Cho Mincheol Whang |
| author_sort | Jing Zhang |
| collection | DOAJ |
| description | Simultaneous activation of brain regions (i.e., brain connection features) is an essential mechanism of brain activity in emotion recognition of visual content. The occipital cortex of the brain is involved in visual processing, but the frontal lobe processes cranial nerve signals to control higher emotions. However, recognition of emotion in visual content merits the analysis of eye movement features, because the pupils, iris, and other eye structures are connected to the nerves of the brain. We hypothesized that when viewing video content, the activation features of brain connections are significantly related to eye movement characteristics. We investigated the relationship between brain connectivity (strength and directionality) and eye movement features (left and right pupils, saccades, and fixations) when 47 participants viewed an emotion-eliciting video on a two-dimensional emotion model (valence and arousal). We found that the connectivity eigenvalues of the long-distance prefrontal lobe, temporal lobe, parietal lobe, and center are related to cognitive activity involving high valance. In addition, saccade movement was correlated with long-distance occipital-frontal connectivity. Finally, short-distance connectivity results showed emotional fluctuations caused by unconscious stimulation. |
| first_indexed | 2024-03-09T22:36:17Z |
| format | Article |
| id | doaj.art-eb1008be4e0a423393767bb25f6f97ea |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T22:36:17Z |
| publishDate | 2022-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-eb1008be4e0a423393767bb25f6f97ea2023-11-23T18:48:24ZengMDPI AGSensors1424-82202022-09-012218673610.3390/s22186736Recognition of Emotion by Brain Connectivity and Eye MovementJing Zhang0Sung Park1Ayoung Cho2Mincheol Whang3Department of Emotion Engineering, Sangmyung University, Seoul 03016, KoreaDepartment of Emotion Engineering, Sangmyung University, Seoul 03016, KoreaDepartment of Emotion Engineering, Sangmyung University, Seoul 03016, KoreaDepartment of Human-Centered Artificial Intelligence, Sangmyung University, Seoul 03016, KoreaSimultaneous activation of brain regions (i.e., brain connection features) is an essential mechanism of brain activity in emotion recognition of visual content. The occipital cortex of the brain is involved in visual processing, but the frontal lobe processes cranial nerve signals to control higher emotions. However, recognition of emotion in visual content merits the analysis of eye movement features, because the pupils, iris, and other eye structures are connected to the nerves of the brain. We hypothesized that when viewing video content, the activation features of brain connections are significantly related to eye movement characteristics. We investigated the relationship between brain connectivity (strength and directionality) and eye movement features (left and right pupils, saccades, and fixations) when 47 participants viewed an emotion-eliciting video on a two-dimensional emotion model (valence and arousal). We found that the connectivity eigenvalues of the long-distance prefrontal lobe, temporal lobe, parietal lobe, and center are related to cognitive activity involving high valance. In addition, saccade movement was correlated with long-distance occipital-frontal connectivity. Finally, short-distance connectivity results showed emotional fluctuations caused by unconscious stimulation.https://www.mdpi.com/1424-8220/22/18/6736emotion recognitionattentioneye movementbrain connectivity |
| spellingShingle | Jing Zhang Sung Park Ayoung Cho Mincheol Whang Recognition of Emotion by Brain Connectivity and Eye Movement Sensors emotion recognition attention eye movement brain connectivity |
| title | Recognition of Emotion by Brain Connectivity and Eye Movement |
| title_full | Recognition of Emotion by Brain Connectivity and Eye Movement |
| title_fullStr | Recognition of Emotion by Brain Connectivity and Eye Movement |
| title_full_unstemmed | Recognition of Emotion by Brain Connectivity and Eye Movement |
| title_short | Recognition of Emotion by Brain Connectivity and Eye Movement |
| title_sort | recognition of emotion by brain connectivity and eye movement |
| topic | emotion recognition attention eye movement brain connectivity |
| url | https://www.mdpi.com/1424-8220/22/18/6736 |
| work_keys_str_mv | AT jingzhang recognitionofemotionbybrainconnectivityandeyemovement AT sungpark recognitionofemotionbybrainconnectivityandeyemovement AT ayoungcho recognitionofemotionbybrainconnectivityandeyemovement AT mincheolwhang recognitionofemotionbybrainconnectivityandeyemovement |