Audio-Visual Integration of Emotional Information
Emotions are central to our perception of the environment surrounding us (Berlyne, 1971). An important aspect in the emotional response to a sound is dependent on the meaning of the sound, ie, it is not the physical parameter per se that determines our emotional response to the sound but rather the...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2011-10-01
|
| Series: | i-Perception |
| Online Access: | https://doi.org/10.1068/ic781 |
| _version_ | 1819225323843092480 |
|---|---|
| author | Penny Bergman Daniel Västfjäll Ana Tajadura-Jiménez |
| author_facet | Penny Bergman Daniel Västfjäll Ana Tajadura-Jiménez |
| author_sort | Penny Bergman |
| collection | DOAJ |
| description | Emotions are central to our perception of the environment surrounding us (Berlyne, 1971). An important aspect in the emotional response to a sound is dependent on the meaning of the sound, ie, it is not the physical parameter per se that determines our emotional response to the sound but rather the source of the sound (Genell, 2008), and the relevance it has to the self (Tajadura-Jiménez et al 2010). When exposed to sound together with visual information, the information from both modalities is integrated, altering the perception of each modality, in order to generate a coherent experience. In emotional information this integration is rapid and without requirements of attentional processes (De Gelder, 1999). The present experiment investigates perception of pink noise in two visual settings in a within-subjects design. Nineteen participants rated the same sound twice in terms of pleasantness and arousal in either a pleasant or an unpleasant visual setting. The results showed that pleasantness of the sound decreased in the negative visual setting, thus suggesting an audio-visual integration, where the affective information in the visual modality is translated to the auditory modality when information-markers are lacking in it. The results are discussed in relation to theories of emotion perception. |
| first_indexed | 2024-12-23T10:07:47Z |
| format | Article |
| id | doaj.art-df92ebf81c0447a59e1511d7964086bc |
| institution | Directory Open Access Journal |
| issn | 2041-6695 |
| language | English |
| last_indexed | 2024-12-23T10:07:47Z |
| publishDate | 2011-10-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | i-Perception |
| spelling | doaj.art-df92ebf81c0447a59e1511d7964086bc2022-12-21T17:51:03ZengSAGE Publishingi-Perception2041-66952011-10-01210.1068/ic78110.1068_ic781Audio-Visual Integration of Emotional InformationPenny Bergman0Daniel VästfjällAna Tajadura-JiménezChalmers University of TechnologyEmotions are central to our perception of the environment surrounding us (Berlyne, 1971). An important aspect in the emotional response to a sound is dependent on the meaning of the sound, ie, it is not the physical parameter per se that determines our emotional response to the sound but rather the source of the sound (Genell, 2008), and the relevance it has to the self (Tajadura-Jiménez et al 2010). When exposed to sound together with visual information, the information from both modalities is integrated, altering the perception of each modality, in order to generate a coherent experience. In emotional information this integration is rapid and without requirements of attentional processes (De Gelder, 1999). The present experiment investigates perception of pink noise in two visual settings in a within-subjects design. Nineteen participants rated the same sound twice in terms of pleasantness and arousal in either a pleasant or an unpleasant visual setting. The results showed that pleasantness of the sound decreased in the negative visual setting, thus suggesting an audio-visual integration, where the affective information in the visual modality is translated to the auditory modality when information-markers are lacking in it. The results are discussed in relation to theories of emotion perception.https://doi.org/10.1068/ic781 |
| spellingShingle | Penny Bergman Daniel Västfjäll Ana Tajadura-Jiménez Audio-Visual Integration of Emotional Information i-Perception |
| title | Audio-Visual Integration of Emotional Information |
| title_full | Audio-Visual Integration of Emotional Information |
| title_fullStr | Audio-Visual Integration of Emotional Information |
| title_full_unstemmed | Audio-Visual Integration of Emotional Information |
| title_short | Audio-Visual Integration of Emotional Information |
| title_sort | audio visual integration of emotional information |
| url | https://doi.org/10.1068/ic781 |
| work_keys_str_mv | AT pennybergman audiovisualintegrationofemotionalinformation AT danielvastfjall audiovisualintegrationofemotionalinformation AT anatajadurajimenez audiovisualintegrationofemotionalinformation |