An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics
Based on the existing research on sound symbolism and crossmodal correspondence, this study proposed an extended research on cross-modal correspondence between various sound attributes and color properties in a group of non-synesthetes. In Experiment 1, we assessed the associations between each prop...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
PeerJ Inc.
2018-03-01
|
| Series: | PeerJ |
| Subjects: | |
| Online Access: | https://peerj.com/articles/4443.pdf |
| _version_ | 1797418706352996352 |
|---|---|
| author | Xiuwen Sun Xiaoling Li Lingyu Ji Feng Han Huifen Wang Yang Liu Yao Chen Zhiyuan Lou Zhuoyun Li |
| author_facet | Xiuwen Sun Xiaoling Li Lingyu Ji Feng Han Huifen Wang Yang Liu Yao Chen Zhiyuan Lou Zhuoyun Li |
| author_sort | Xiuwen Sun |
| collection | DOAJ |
| description | Based on the existing research on sound symbolism and crossmodal correspondence, this study proposed an extended research on cross-modal correspondence between various sound attributes and color properties in a group of non-synesthetes. In Experiment 1, we assessed the associations between each property of sounds and colors. Twenty sounds with five auditory properties (pitch, roughness, sharpness, tempo and discontinuity), each varied in four levels, were used as the sound stimuli. Forty-nine colors with different hues, saturation and brightness were used to match to those sounds. Result revealed that besides pitch and tempo, roughness and sharpness also played roles in sound-color correspondence. Reaction times of sound-hue were a little longer than the reaction times of sound-lightness. In Experiment 2, a speeded target discrimination task was used to assess whether the associations between sound attributes and color properties could invoke natural cross-modal correspondence and improve participants’ cognitive efficiency in cognitive tasks. Several typical sound-color pairings were selected according to the results of Experiment 1. Participants were divided into two groups (congruent and incongruent). In each trial participants had to judge whether the presented color could appropriately be associated with the sound stimuli. Result revealed that participants responded more quickly and accurately in the congruent group than in the incongruent group. It was also found that there was no significant difference in reaction times and error rates between sound-hue and sound-lightness. The results of Experiment 1 and 2 indicate the existence of a robust crossmodal correspondence between multiple attributes of sound and color, which also has strong influence on cognitive tasks. The inconsistency of the reaction times between sound-hue and sound-lightness in Experiment 1 and 2 is probably owing to the difference in experimental protocol, which indicates that the complexity of experiment design may be an important factor in crossmodal correspondence phenomena. |
| first_indexed | 2024-03-09T06:36:49Z |
| format | Article |
| id | doaj.art-00c1051b4835478c9d0dd3c0e1e8ce4c |
| institution | Directory Open Access Journal |
| issn | 2167-8359 |
| language | English |
| last_indexed | 2024-03-09T06:36:49Z |
| publishDate | 2018-03-01 |
| publisher | PeerJ Inc. |
| record_format | Article |
| series | PeerJ |
| spelling | doaj.art-00c1051b4835478c9d0dd3c0e1e8ce4c2023-12-03T10:56:01ZengPeerJ Inc.PeerJ2167-83592018-03-016e444310.7717/peerj.4443An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomicsXiuwen Sun0Xiaoling Li1Lingyu Ji2Feng Han3Huifen Wang4Yang Liu5Yao Chen6Zhiyuan Lou7Zhuoyun Li8School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaSchool of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi, ChinaXi’an Gaoxin No.1 Hign School International Course Center, Xi’an, ChinaBased on the existing research on sound symbolism and crossmodal correspondence, this study proposed an extended research on cross-modal correspondence between various sound attributes and color properties in a group of non-synesthetes. In Experiment 1, we assessed the associations between each property of sounds and colors. Twenty sounds with five auditory properties (pitch, roughness, sharpness, tempo and discontinuity), each varied in four levels, were used as the sound stimuli. Forty-nine colors with different hues, saturation and brightness were used to match to those sounds. Result revealed that besides pitch and tempo, roughness and sharpness also played roles in sound-color correspondence. Reaction times of sound-hue were a little longer than the reaction times of sound-lightness. In Experiment 2, a speeded target discrimination task was used to assess whether the associations between sound attributes and color properties could invoke natural cross-modal correspondence and improve participants’ cognitive efficiency in cognitive tasks. Several typical sound-color pairings were selected according to the results of Experiment 1. Participants were divided into two groups (congruent and incongruent). In each trial participants had to judge whether the presented color could appropriately be associated with the sound stimuli. Result revealed that participants responded more quickly and accurately in the congruent group than in the incongruent group. It was also found that there was no significant difference in reaction times and error rates between sound-hue and sound-lightness. The results of Experiment 1 and 2 indicate the existence of a robust crossmodal correspondence between multiple attributes of sound and color, which also has strong influence on cognitive tasks. The inconsistency of the reaction times between sound-hue and sound-lightness in Experiment 1 and 2 is probably owing to the difference in experimental protocol, which indicates that the complexity of experiment design may be an important factor in crossmodal correspondence phenomena.https://peerj.com/articles/4443.pdfCrossmodal correspondencesPhylosophySoundColorSpeed-discriminationAttributes |
| spellingShingle | Xiuwen Sun Xiaoling Li Lingyu Ji Feng Han Huifen Wang Yang Liu Yao Chen Zhiyuan Lou Zhuoyun Li An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics PeerJ Crossmodal correspondences Phylosophy Sound Color Speed-discrimination Attributes |
| title | An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics |
| title_full | An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics |
| title_fullStr | An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics |
| title_full_unstemmed | An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics |
| title_short | An extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics |
| title_sort | extended research of crossmodal correspondence between color and sound in psychology and cognitive ergonomics |
| topic | Crossmodal correspondences Phylosophy Sound Color Speed-discrimination Attributes |
| url | https://peerj.com/articles/4443.pdf |
| work_keys_str_mv | AT xiuwensun anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT xiaolingli anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT lingyuji anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT fenghan anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT huifenwang anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT yangliu anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT yaochen anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT zhiyuanlou anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT zhuoyunli anextendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT xiuwensun extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT xiaolingli extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT lingyuji extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT fenghan extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT huifenwang extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT yangliu extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT yaochen extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT zhiyuanlou extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics AT zhuoyunli extendedresearchofcrossmodalcorrespondencebetweencolorandsoundinpsychologyandcognitiveergonomics |