Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
This study reports experimental results on whether the acoustic realization of vocal emotions differs between Mandarin and English. Prosodic cues, spectral cues and articulatory cues generated by electroglottograph (EGG) of five emotions (anger, fear, happiness, sadness and neutral) were compared wi...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2018-12-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/8/12/2629 |
_version_ | 1819140704342900736 |
---|---|
author | Ting Wang Yong-cheol Lee Qiuwu Ma |
author_facet | Ting Wang Yong-cheol Lee Qiuwu Ma |
author_sort | Ting Wang |
collection | DOAJ |
description | This study reports experimental results on whether the acoustic realization of vocal emotions differs between Mandarin and English. Prosodic cues, spectral cues and articulatory cues generated by electroglottograph (EGG) of five emotions (anger, fear, happiness, sadness and neutral) were compared within and across Mandarin and English through a production experiment. Results of within-language comparison demonstrated that each vocal emotion had specific acoustic patterns in each language. Moreover, normalized data were used in the across-language comparison analysis. Results indicated that Mandarin and English showed different mechanisms of utilizing pitch for encoding emotions. The differences in pitch variation between neutral and other emotions were significantly larger in English than in Mandarin. However, the variations of speech rate and certain phonation cues (e.g., CPP (Cepstral Peak Prominence) and CQ (Contact quotient)) were significantly greater in Mandarin than in English. The differences in emotional speech between the two languages may be due to the restriction of pitch variation by the presence of lexical tones in Mandarin. This study reveals an interesting finding that occurs when a certain cue (e.g., pitch) is restricted in one language, other cues were strengthened to take on the responsibility of differentiating vocal emotions. Therefore, we posit that the acoustic realizations of emotional speech are multidimensional. |
first_indexed | 2024-12-22T11:42:47Z |
format | Article |
id | doaj.art-45ca728e8e8f45a6a3b291c70dfef0f9 |
institution | Directory Open Access Journal |
issn | 2076-3417 |
language | English |
last_indexed | 2024-12-22T11:42:47Z |
publishDate | 2018-12-01 |
publisher | MDPI AG |
record_format | Article |
series | Applied Sciences |
spelling | doaj.art-45ca728e8e8f45a6a3b291c70dfef0f92022-12-21T18:27:13ZengMDPI AGApplied Sciences2076-34172018-12-01812262910.3390/app8122629app8122629Within and Across-Language Comparison of Vocal Emotions in Mandarin and EnglishTing Wang0Yong-cheol Lee1Qiuwu Ma2School of Foreign Languages, Tongji University, Shanghai 200092, ChinaDepartment of English Literature and Language, Cheongju University, Cheongju 28503, KoreaSchool of Foreign Languages and Literature, Fudan University, Shanghai 200433, ChinaThis study reports experimental results on whether the acoustic realization of vocal emotions differs between Mandarin and English. Prosodic cues, spectral cues and articulatory cues generated by electroglottograph (EGG) of five emotions (anger, fear, happiness, sadness and neutral) were compared within and across Mandarin and English through a production experiment. Results of within-language comparison demonstrated that each vocal emotion had specific acoustic patterns in each language. Moreover, normalized data were used in the across-language comparison analysis. Results indicated that Mandarin and English showed different mechanisms of utilizing pitch for encoding emotions. The differences in pitch variation between neutral and other emotions were significantly larger in English than in Mandarin. However, the variations of speech rate and certain phonation cues (e.g., CPP (Cepstral Peak Prominence) and CQ (Contact quotient)) were significantly greater in Mandarin than in English. The differences in emotional speech between the two languages may be due to the restriction of pitch variation by the presence of lexical tones in Mandarin. This study reveals an interesting finding that occurs when a certain cue (e.g., pitch) is restricted in one language, other cues were strengthened to take on the responsibility of differentiating vocal emotions. Therefore, we posit that the acoustic realizations of emotional speech are multidimensional.https://www.mdpi.com/2076-3417/8/12/2629emotional speechpitch variationMandarinEnglish |
spellingShingle | Ting Wang Yong-cheol Lee Qiuwu Ma Within and Across-Language Comparison of Vocal Emotions in Mandarin and English Applied Sciences emotional speech pitch variation Mandarin English |
title | Within and Across-Language Comparison of Vocal Emotions in Mandarin and English |
title_full | Within and Across-Language Comparison of Vocal Emotions in Mandarin and English |
title_fullStr | Within and Across-Language Comparison of Vocal Emotions in Mandarin and English |
title_full_unstemmed | Within and Across-Language Comparison of Vocal Emotions in Mandarin and English |
title_short | Within and Across-Language Comparison of Vocal Emotions in Mandarin and English |
title_sort | within and across language comparison of vocal emotions in mandarin and english |
topic | emotional speech pitch variation Mandarin English |
url | https://www.mdpi.com/2076-3417/8/12/2629 |
work_keys_str_mv | AT tingwang withinandacrosslanguagecomparisonofvocalemotionsinmandarinandenglish AT yongcheollee withinandacrosslanguagecomparisonofvocalemotionsinmandarinandenglish AT qiuwuma withinandacrosslanguagecomparisonofvocalemotionsinmandarinandenglish |