Within and Across-Language Comparison of Vocal Emotions in Mandarin and English

This study reports experimental results on whether the acoustic realization of vocal emotions differs between Mandarin and English. Prosodic cues, spectral cues and articulatory cues generated by electroglottograph (EGG) of five emotions (anger, fear, happiness, sadness and neutral) were compared wi...

Full description

Bibliographic Details
Main Authors: Ting Wang, Yong-cheol Lee, Qiuwu Ma
Format: Article
Language:English
Published: MDPI AG 2018-12-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/8/12/2629
_version_ 1819140704342900736
author Ting Wang
Yong-cheol Lee
Qiuwu Ma
author_facet Ting Wang
Yong-cheol Lee
Qiuwu Ma
author_sort Ting Wang
collection DOAJ
description This study reports experimental results on whether the acoustic realization of vocal emotions differs between Mandarin and English. Prosodic cues, spectral cues and articulatory cues generated by electroglottograph (EGG) of five emotions (anger, fear, happiness, sadness and neutral) were compared within and across Mandarin and English through a production experiment. Results of within-language comparison demonstrated that each vocal emotion had specific acoustic patterns in each language. Moreover, normalized data were used in the across-language comparison analysis. Results indicated that Mandarin and English showed different mechanisms of utilizing pitch for encoding emotions. The differences in pitch variation between neutral and other emotions were significantly larger in English than in Mandarin. However, the variations of speech rate and certain phonation cues (e.g., CPP (Cepstral Peak Prominence) and CQ (Contact quotient)) were significantly greater in Mandarin than in English. The differences in emotional speech between the two languages may be due to the restriction of pitch variation by the presence of lexical tones in Mandarin. This study reveals an interesting finding that occurs when a certain cue (e.g., pitch) is restricted in one language, other cues were strengthened to take on the responsibility of differentiating vocal emotions. Therefore, we posit that the acoustic realizations of emotional speech are multidimensional.
first_indexed 2024-12-22T11:42:47Z
format Article
id doaj.art-45ca728e8e8f45a6a3b291c70dfef0f9
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-12-22T11:42:47Z
publishDate 2018-12-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-45ca728e8e8f45a6a3b291c70dfef0f92022-12-21T18:27:13ZengMDPI AGApplied Sciences2076-34172018-12-01812262910.3390/app8122629app8122629Within and Across-Language Comparison of Vocal Emotions in Mandarin and EnglishTing Wang0Yong-cheol Lee1Qiuwu Ma2School of Foreign Languages, Tongji University, Shanghai 200092, ChinaDepartment of English Literature and Language, Cheongju University, Cheongju 28503, KoreaSchool of Foreign Languages and Literature, Fudan University, Shanghai 200433, ChinaThis study reports experimental results on whether the acoustic realization of vocal emotions differs between Mandarin and English. Prosodic cues, spectral cues and articulatory cues generated by electroglottograph (EGG) of five emotions (anger, fear, happiness, sadness and neutral) were compared within and across Mandarin and English through a production experiment. Results of within-language comparison demonstrated that each vocal emotion had specific acoustic patterns in each language. Moreover, normalized data were used in the across-language comparison analysis. Results indicated that Mandarin and English showed different mechanisms of utilizing pitch for encoding emotions. The differences in pitch variation between neutral and other emotions were significantly larger in English than in Mandarin. However, the variations of speech rate and certain phonation cues (e.g., CPP (Cepstral Peak Prominence) and CQ (Contact quotient)) were significantly greater in Mandarin than in English. The differences in emotional speech between the two languages may be due to the restriction of pitch variation by the presence of lexical tones in Mandarin. This study reveals an interesting finding that occurs when a certain cue (e.g., pitch) is restricted in one language, other cues were strengthened to take on the responsibility of differentiating vocal emotions. Therefore, we posit that the acoustic realizations of emotional speech are multidimensional.https://www.mdpi.com/2076-3417/8/12/2629emotional speechpitch variationMandarinEnglish
spellingShingle Ting Wang
Yong-cheol Lee
Qiuwu Ma
Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
Applied Sciences
emotional speech
pitch variation
Mandarin
English
title Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
title_full Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
title_fullStr Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
title_full_unstemmed Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
title_short Within and Across-Language Comparison of Vocal Emotions in Mandarin and English
title_sort within and across language comparison of vocal emotions in mandarin and english
topic emotional speech
pitch variation
Mandarin
English
url https://www.mdpi.com/2076-3417/8/12/2629
work_keys_str_mv AT tingwang withinandacrosslanguagecomparisonofvocalemotionsinmandarinandenglish
AT yongcheollee withinandacrosslanguagecomparisonofvocalemotionsinmandarinandenglish
AT qiuwuma withinandacrosslanguagecomparisonofvocalemotionsinmandarinandenglish