Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups
Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural...
| Main Authors: | , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/172509 |
| _version_ | 1811690979036495872 |
|---|---|
| author | Shang, Nan Styles, Suzy J. |
| author2 | School of Social Sciences |
| author_facet | School of Social Sciences Shang, Nan Styles, Suzy J. |
| author_sort | Shang, Nan |
| collection | NTU |
| description | Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception. |
| first_indexed | 2024-10-01T06:12:35Z |
| format | Journal Article |
| id | ntu-10356/172509 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T06:12:35Z |
| publishDate | 2023 |
| record_format | dspace |
| spelling | ntu-10356/1725092023-12-17T15:30:22Z Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups Shang, Nan Styles, Suzy J. School of Social Sciences Centre for Research and Development in Learning (CRADLE) Social sciences::Psychology Cross-Modal Associations Sound Symbolism Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception. Nanyang Technological University National Research Foundation (NRF) Published version The research was supported by the Funda-mental Research Funds for the Central Universities (31020180QD143) to NS, the NAP SUG from Nanyang Technological University (NAPSUG: M4081215) and the National Research Foundation, Singapore (NRF2016-SOL002-011) to SJS. 2023-12-12T04:39:52Z 2023-12-12T04:39:52Z 2023 Journal Article Shang, N. & Styles, S. J. (2023). Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups. Cognitive Science, 47(1), e13221-. https://dx.doi.org/10.1111/cogs.13221 0364-0213 https://hdl.handle.net/10356/172509 10.1111/cogs.13221 36607162 2-s2.0-85147029311 1 47 e13221 en M4081215 NRF2016-SOL002-011 Cognitive Science © 2022 The Authors. Cognitive Science published by Wiley Periodicals LLC on behalf of Cognitive Science Society (CSS).This is an open access article under the terms of the Creative Commons Attribution-NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes. application/pdf |
| spellingShingle | Social sciences::Psychology Cross-Modal Associations Sound Symbolism Shang, Nan Styles, Suzy J. Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups |
| title | Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups |
| title_full | Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups |
| title_fullStr | Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups |
| title_full_unstemmed | Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups |
| title_short | Implicit Association Test (IAT) studies investigating pitch-shape audiovisual cross-modal associations across language groups |
| title_sort | implicit association test iat studies investigating pitch shape audiovisual cross modal associations across language groups |
| topic | Social sciences::Psychology Cross-Modal Associations Sound Symbolism |
| url | https://hdl.handle.net/10356/172509 |
| work_keys_str_mv | AT shangnan implicitassociationtestiatstudiesinvestigatingpitchshapeaudiovisualcrossmodalassociationsacrosslanguagegroups AT stylessuzyj implicitassociationtestiatstudiesinvestigatingpitchshapeaudiovisualcrossmodalassociationsacrosslanguagegroups |