Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception
We previously investigated the perception of noise-vocoded speech to determine whether the temporal amplitude envelope (TAE) of speech plays an important role in the perception of linguistic information as well as non-linguistic information. However, it remains unclear if these TAEs also play a role...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-05-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/10/6239 |
| _version_ | 1797601227567005696 |
|---|---|
| author | Masashi Unoki Miho Kawamura Maori Kobayashi Shunsuke Kidani Junfeng Li Masato Akagi |
| author_facet | Masashi Unoki Miho Kawamura Maori Kobayashi Shunsuke Kidani Junfeng Li Masato Akagi |
| author_sort | Masashi Unoki |
| collection | DOAJ |
| description | We previously investigated the perception of noise-vocoded speech to determine whether the temporal amplitude envelope (TAE) of speech plays an important role in the perception of linguistic information as well as non-linguistic information. However, it remains unclear if these TAEs also play a role in the urgency perception of non-linguistic information. In this paper, we comprehensively investigated whether the TAE of speech contributes to urgency perception. To this end, we compared noise-vocoded stimuli containing TAEs identical to those of original speech with those containing TAEs controlled by low-pass or high-pass filtering. We derived degrees of urgency from a paired comparison of the results and then used them as a basis to clarify the relationship between the temporal modulation components in TAEs of speech and urgency perception. Our findings revealed that (1) the perceived degrees of urgency of noise-vocoded stimuli are similar to those of the original, (2) significant cues for urgency perception are temporal modulation components of the noise-vocoded stimuli higher than the modulation frequency of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mn>6</mn></semantics></math></inline-formula> Hz, (3) additional significant cues for urgency perception are temporal modulation components of the noise-vocoded stimuli lower than the modulation frequency of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mn>8</mn></semantics></math></inline-formula> Hz, and (4) the TAE of the time-reversal speech is not likely to contain important cues for the perception of urgency. We therefore conclude that temporal modulation cues in the TAE of speech are a significant component in the perception of urgency. |
| first_indexed | 2024-03-11T03:58:12Z |
| format | Article |
| id | doaj.art-f69c317018dd4a3c9656344d884ed1ca |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T03:58:12Z |
| publishDate | 2023-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-f69c317018dd4a3c9656344d884ed1ca2023-11-18T00:22:41ZengMDPI AGApplied Sciences2076-34172023-05-011310623910.3390/app13106239Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency PerceptionMasashi Unoki0Miho Kawamura1Maori Kobayashi2Shunsuke Kidani3Junfeng Li4Masato Akagi5School of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi 923-1292, JapanSchool of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi 923-1292, JapanSchool of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi 923-1292, JapanSchool of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi 923-1292, JapanInstitute of Acoustics, Chinese Academy of China, No. 21, Beisihuan Xilu, Haidian, Beijing 100190, ChinaSchool of Information Science, Japan Advanced Institute of Science and Technology, 1-1 Asahidai, Nomi 923-1292, JapanWe previously investigated the perception of noise-vocoded speech to determine whether the temporal amplitude envelope (TAE) of speech plays an important role in the perception of linguistic information as well as non-linguistic information. However, it remains unclear if these TAEs also play a role in the urgency perception of non-linguistic information. In this paper, we comprehensively investigated whether the TAE of speech contributes to urgency perception. To this end, we compared noise-vocoded stimuli containing TAEs identical to those of original speech with those containing TAEs controlled by low-pass or high-pass filtering. We derived degrees of urgency from a paired comparison of the results and then used them as a basis to clarify the relationship between the temporal modulation components in TAEs of speech and urgency perception. Our findings revealed that (1) the perceived degrees of urgency of noise-vocoded stimuli are similar to those of the original, (2) significant cues for urgency perception are temporal modulation components of the noise-vocoded stimuli higher than the modulation frequency of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mn>6</mn></semantics></math></inline-formula> Hz, (3) additional significant cues for urgency perception are temporal modulation components of the noise-vocoded stimuli lower than the modulation frequency of <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mn>8</mn></semantics></math></inline-formula> Hz, and (4) the TAE of the time-reversal speech is not likely to contain important cues for the perception of urgency. We therefore conclude that temporal modulation cues in the TAE of speech are a significant component in the perception of urgency.https://www.mdpi.com/2076-3417/13/10/6239noise-vocoded speechtemporal modulation cueurgency perceptiontemporal amplitude envelope |
| spellingShingle | Masashi Unoki Miho Kawamura Maori Kobayashi Shunsuke Kidani Junfeng Li Masato Akagi Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception Applied Sciences noise-vocoded speech temporal modulation cue urgency perception temporal amplitude envelope |
| title | Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception |
| title_full | Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception |
| title_fullStr | Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception |
| title_full_unstemmed | Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception |
| title_short | Contributions of Temporal Modulation Cues in Temporal Amplitude Envelope of Speech to Urgency Perception |
| title_sort | contributions of temporal modulation cues in temporal amplitude envelope of speech to urgency perception |
| topic | noise-vocoded speech temporal modulation cue urgency perception temporal amplitude envelope |
| url | https://www.mdpi.com/2076-3417/13/10/6239 |
| work_keys_str_mv | AT masashiunoki contributionsoftemporalmodulationcuesintemporalamplitudeenvelopeofspeechtourgencyperception AT mihokawamura contributionsoftemporalmodulationcuesintemporalamplitudeenvelopeofspeechtourgencyperception AT maorikobayashi contributionsoftemporalmodulationcuesintemporalamplitudeenvelopeofspeechtourgencyperception AT shunsukekidani contributionsoftemporalmodulationcuesintemporalamplitudeenvelopeofspeechtourgencyperception AT junfengli contributionsoftemporalmodulationcuesintemporalamplitudeenvelopeofspeechtourgencyperception AT masatoakagi contributionsoftemporalmodulationcuesintemporalamplitudeenvelopeofspeechtourgencyperception |