Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials
Music and speech both communicate emotional meanings in addition to their domain-specific contents. But it is not clear whether and how the two kinds of emotional meanings are linked. The present study is focused on exploring the emotional connotations of musical timbre of isolated instrument sounds...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2018-05-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/article/10.3389/fpsyg.2018.00737/full |
| _version_ | 1828416650204938240 |
|---|---|
| author | Xiaoluan Liu Yi Xu Kai Alter Kai Alter Jyrki Tuomainen |
| author_facet | Xiaoluan Liu Yi Xu Kai Alter Kai Alter Jyrki Tuomainen |
| author_sort | Xiaoluan Liu |
| collection | DOAJ |
| description | Music and speech both communicate emotional meanings in addition to their domain-specific contents. But it is not clear whether and how the two kinds of emotional meanings are linked. The present study is focused on exploring the emotional connotations of musical timbre of isolated instrument sounds through the perspective of emotional speech prosody. The stimuli were isolated instrument sounds and emotional speech prosody categorized by listeners into anger, happiness and sadness, respectively. We first analyzed the timbral features of the stimuli, which showed that relations between the three emotions were relatively consistent in those features for speech and music. The results further echo the size-code hypothesis in which different sound timbre indicates different body size projections. Then we conducted an ERP experiment using a priming paradigm with isolated instrument sounds as primes and emotional speech prosody as targets. The results showed that emotionally incongruent instrument-speech pairs triggered a larger N400 response than emotionally congruent pairs. Taken together, this is the first study to provide evidence that the timbre of simple and isolated musical instrument sounds can convey emotion in a way similar to emotional speech prosody. |
| first_indexed | 2024-12-10T14:06:20Z |
| format | Article |
| id | doaj.art-42c6e5e024224dd08ffad72c2eeca00d |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-10T14:06:20Z |
| publishDate | 2018-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-42c6e5e024224dd08ffad72c2eeca00d2022-12-22T01:45:39ZengFrontiers Media S.A.Frontiers in Psychology1664-10782018-05-01910.3389/fpsyg.2018.00737333969Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related PotentialsXiaoluan Liu0Yi Xu1Kai Alter2Kai Alter3Jyrki Tuomainen4Department of Speech, Hearing and Phonetic Sciences, University College London, London, United KingdomDepartment of Speech, Hearing and Phonetic Sciences, University College London, London, United KingdomFaculty of Linguistics, Philology and Phonetics, University of Oxford, Oxford, United KingdomInstitute of Neuroscience, Newcastle University, Newcastle upon Tyne, United KingdomDepartment of Speech, Hearing and Phonetic Sciences, University College London, London, United KingdomMusic and speech both communicate emotional meanings in addition to their domain-specific contents. But it is not clear whether and how the two kinds of emotional meanings are linked. The present study is focused on exploring the emotional connotations of musical timbre of isolated instrument sounds through the perspective of emotional speech prosody. The stimuli were isolated instrument sounds and emotional speech prosody categorized by listeners into anger, happiness and sadness, respectively. We first analyzed the timbral features of the stimuli, which showed that relations between the three emotions were relatively consistent in those features for speech and music. The results further echo the size-code hypothesis in which different sound timbre indicates different body size projections. Then we conducted an ERP experiment using a priming paradigm with isolated instrument sounds as primes and emotional speech prosody as targets. The results showed that emotionally incongruent instrument-speech pairs triggered a larger N400 response than emotionally congruent pairs. Taken together, this is the first study to provide evidence that the timbre of simple and isolated musical instrument sounds can convey emotion in a way similar to emotional speech prosody.http://journal.frontiersin.org/article/10.3389/fpsyg.2018.00737/fullmusical timbreemotional speech prosodyemotionERPN400 |
| spellingShingle | Xiaoluan Liu Yi Xu Kai Alter Kai Alter Jyrki Tuomainen Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials Frontiers in Psychology musical timbre emotional speech prosody emotion ERP N400 |
| title | Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials |
| title_full | Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials |
| title_fullStr | Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials |
| title_full_unstemmed | Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials |
| title_short | Emotional Connotations of Musical Instrument Timbre in Comparison With Emotional Speech Prosody: Evidence From Acoustics and Event-Related Potentials |
| title_sort | emotional connotations of musical instrument timbre in comparison with emotional speech prosody evidence from acoustics and event related potentials |
| topic | musical timbre emotional speech prosody emotion ERP N400 |
| url | http://journal.frontiersin.org/article/10.3389/fpsyg.2018.00737/full |
| work_keys_str_mv | AT xiaoluanliu emotionalconnotationsofmusicalinstrumenttimbreincomparisonwithemotionalspeechprosodyevidencefromacousticsandeventrelatedpotentials AT yixu emotionalconnotationsofmusicalinstrumenttimbreincomparisonwithemotionalspeechprosodyevidencefromacousticsandeventrelatedpotentials AT kaialter emotionalconnotationsofmusicalinstrumenttimbreincomparisonwithemotionalspeechprosodyevidencefromacousticsandeventrelatedpotentials AT kaialter emotionalconnotationsofmusicalinstrumenttimbreincomparisonwithemotionalspeechprosodyevidencefromacousticsandeventrelatedpotentials AT jyrkituomainen emotionalconnotationsofmusicalinstrumenttimbreincomparisonwithemotionalspeechprosodyevidencefromacousticsandeventrelatedpotentials |