Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention
It has been reported that attending to stimuli in visual modality can spread to task-irrelevant but synchronously presented stimuli in auditory modality, a phenomenon termed the cross-modal spread of attention, which could be either stimulus-driven or representation-driven depending on whether the v...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-09-01
|
| Series: | Brain Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3425/12/9/1229 |
| _version_ | 1797490502467059712 |
|---|---|
| author | Minran Chen Song Zhao Jiaqi Yu Xuechen Leng Mengdie Zhai Chengzhi Feng Wenfeng Feng |
| author_facet | Minran Chen Song Zhao Jiaqi Yu Xuechen Leng Mengdie Zhai Chengzhi Feng Wenfeng Feng |
| author_sort | Minran Chen |
| collection | DOAJ |
| description | It has been reported that attending to stimuli in visual modality can spread to task-irrelevant but synchronously presented stimuli in auditory modality, a phenomenon termed the cross-modal spread of attention, which could be either stimulus-driven or representation-driven depending on whether the visual constituent of an audiovisual object is further selected based on the object representation. The stimulus-driven spread of attention occurs whenever a task-irrelevant sound synchronizes with an attended visual stimulus, regardless of the cross-modal semantic congruency. The present study recorded event-related potentials (ERPs) to investigate whether the stimulus-driven cross-modal spread of attention could be modulated by audio-visual emotional congruency in a visual oddball task where emotion (positive/negative) was task-irrelevant. The results first demonstrated a prominent stimulus-driven spread of attention regardless of audio-visual emotional congruency by showing that for all audiovisual pairs, the extracted ERPs to the auditory constituents of audiovisual stimuli within the time window of 200–300 ms were significantly larger than ERPs to the same auditory stimuli delivered alone. However, the amplitude of this stimulus-driven auditory Nd component during 200–300 ms was significantly larger for emotionally incongruent than congruent audiovisual stimuli when their visual constituents’ emotional valences were negative. Moreover, the Nd was sustained during 300–400 ms only for the incongruent audiovisual stimuli with emotionally negative visual constituents. These findings suggest that although the occurrence of the stimulus-driven cross-modal spread of attention is independent of audio-visual emotional congruency, its magnitude is nevertheless modulated even when emotion is task-irrelevant. |
| first_indexed | 2024-03-10T00:33:52Z |
| format | Article |
| id | doaj.art-df060f98fca841a98651dff03d945bc6 |
| institution | Directory Open Access Journal |
| issn | 2076-3425 |
| language | English |
| last_indexed | 2024-03-10T00:33:52Z |
| publishDate | 2022-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Brain Sciences |
| spelling | doaj.art-df060f98fca841a98651dff03d945bc62023-11-23T15:21:24ZengMDPI AGBrain Sciences2076-34252022-09-01129122910.3390/brainsci12091229Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of AttentionMinran Chen0Song Zhao1Jiaqi Yu2Xuechen Leng3Mengdie Zhai4Chengzhi Feng5Wenfeng Feng6Department of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, School of Education, Soochow University, Suzhou 215123, ChinaIt has been reported that attending to stimuli in visual modality can spread to task-irrelevant but synchronously presented stimuli in auditory modality, a phenomenon termed the cross-modal spread of attention, which could be either stimulus-driven or representation-driven depending on whether the visual constituent of an audiovisual object is further selected based on the object representation. The stimulus-driven spread of attention occurs whenever a task-irrelevant sound synchronizes with an attended visual stimulus, regardless of the cross-modal semantic congruency. The present study recorded event-related potentials (ERPs) to investigate whether the stimulus-driven cross-modal spread of attention could be modulated by audio-visual emotional congruency in a visual oddball task where emotion (positive/negative) was task-irrelevant. The results first demonstrated a prominent stimulus-driven spread of attention regardless of audio-visual emotional congruency by showing that for all audiovisual pairs, the extracted ERPs to the auditory constituents of audiovisual stimuli within the time window of 200–300 ms were significantly larger than ERPs to the same auditory stimuli delivered alone. However, the amplitude of this stimulus-driven auditory Nd component during 200–300 ms was significantly larger for emotionally incongruent than congruent audiovisual stimuli when their visual constituents’ emotional valences were negative. Moreover, the Nd was sustained during 300–400 ms only for the incongruent audiovisual stimuli with emotionally negative visual constituents. These findings suggest that although the occurrence of the stimulus-driven cross-modal spread of attention is independent of audio-visual emotional congruency, its magnitude is nevertheless modulated even when emotion is task-irrelevant.https://www.mdpi.com/2076-3425/12/9/1229emotional congruencyspread of attentionstimulus-drivencross-modal interactionERP |
| spellingShingle | Minran Chen Song Zhao Jiaqi Yu Xuechen Leng Mengdie Zhai Chengzhi Feng Wenfeng Feng Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention Brain Sciences emotional congruency spread of attention stimulus-driven cross-modal interaction ERP |
| title | Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention |
| title_full | Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention |
| title_fullStr | Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention |
| title_full_unstemmed | Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention |
| title_short | Audiovisual Emotional Congruency Modulates the Stimulus-Driven Cross-Modal Spread of Attention |
| title_sort | audiovisual emotional congruency modulates the stimulus driven cross modal spread of attention |
| topic | emotional congruency spread of attention stimulus-driven cross-modal interaction ERP |
| url | https://www.mdpi.com/2076-3425/12/9/1229 |
| work_keys_str_mv | AT minranchen audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention AT songzhao audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention AT jiaqiyu audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention AT xuechenleng audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention AT mengdiezhai audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention AT chengzhifeng audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention AT wenfengfeng audiovisualemotionalcongruencymodulatesthestimulusdrivencrossmodalspreadofattention |