The Impact of Cross-modal Correspondences on Working Memory Performance
Crossmodal correspondences influence perceptual performance in adults, infants, and even non-human primates across a variety of different sensory modalities and dimensions, including in tasks involving speeded detection, discrimination, and categorization. However, to date, it is still unclear wheth...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal article |
| Published: |
American Psychological Association
2017
|
| _version_ | 1797098948059463680 |
|---|---|
| author | Brunetti, R Indraccolo, I Mastroberardino, S Spence, C Santangelo, V |
| author_facet | Brunetti, R Indraccolo, I Mastroberardino, S Spence, C Santangelo, V |
| author_sort | Brunetti, R |
| collection | OXFORD |
| description | Crossmodal correspondences influence perceptual performance in adults, infants, and even non-human primates across a variety of different sensory modalities and dimensions, including in tasks involving speeded detection, discrimination, and categorization. However, to date, it is still unclear whether and how correspondences could modulate post-perceptual processes, such as working memory (WM). Here we investigated this issue using a bimodal (audiovisual) 2-back task. In Experiment 1, three kinds of correspondences were used: audio/visual numerosity, pitch/shape, and pitch/elevation, each presented congruently (e.g., for numerosity: three auditory tones along with three visual shapes) or incongruently (3tones/2shapes). Participants attended to the visual or auditory modalities, or both, simultaneously. The results revealed faster target-detection latencies following congruent as compared to incongruent stimulation, especially for numerosity congruence. In Experiment 2, we therefore focused on numerosity, varying the correspondence of the unattended modality, thus having correspondences at both sample (e.g., 3tones/3shapes) and target (e.g., 3tones/3shapes), only at sample (sample: 3tones/3shapes; target: 3tones/2shapes), only at target (sample: 3tones/2shapes; target: 3tones/3shapes), or never. In order to investigate the format of the encoded information we also included “symbolic” quantities (i.e., visually/auditorily-presented digits). The results confirmed the facilitation of correspondences on WM performance, highlighting that the effect arises when the correspondence is at the target display, thus affecting response selection. Moreover, the experiment revealed modal differences in the effect, showing how symbolic information affects the auditory and visual modalities differently. Overall, these findings highlight the impact of crossmodal correspondences on WM processing, adding new light on the link between perceptual and post-perceptual stages of human information processing. |
| first_indexed | 2024-03-07T05:16:48Z |
| format | Journal article |
| id | oxford-uuid:dd7d7a78-016a-4cc9-aeeb-f070e31a3401 |
| institution | University of Oxford |
| last_indexed | 2024-03-07T05:16:48Z |
| publishDate | 2017 |
| publisher | American Psychological Association |
| record_format | dspace |
| spelling | oxford-uuid:dd7d7a78-016a-4cc9-aeeb-f070e31a34012022-03-27T09:25:30ZThe Impact of Cross-modal Correspondences on Working Memory PerformanceJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:dd7d7a78-016a-4cc9-aeeb-f070e31a3401Symplectic Elements at OxfordAmerican Psychological Association2017Brunetti, RIndraccolo, IMastroberardino, SSpence, CSantangelo, VCrossmodal correspondences influence perceptual performance in adults, infants, and even non-human primates across a variety of different sensory modalities and dimensions, including in tasks involving speeded detection, discrimination, and categorization. However, to date, it is still unclear whether and how correspondences could modulate post-perceptual processes, such as working memory (WM). Here we investigated this issue using a bimodal (audiovisual) 2-back task. In Experiment 1, three kinds of correspondences were used: audio/visual numerosity, pitch/shape, and pitch/elevation, each presented congruently (e.g., for numerosity: three auditory tones along with three visual shapes) or incongruently (3tones/2shapes). Participants attended to the visual or auditory modalities, or both, simultaneously. The results revealed faster target-detection latencies following congruent as compared to incongruent stimulation, especially for numerosity congruence. In Experiment 2, we therefore focused on numerosity, varying the correspondence of the unattended modality, thus having correspondences at both sample (e.g., 3tones/3shapes) and target (e.g., 3tones/3shapes), only at sample (sample: 3tones/3shapes; target: 3tones/2shapes), only at target (sample: 3tones/2shapes; target: 3tones/3shapes), or never. In order to investigate the format of the encoded information we also included “symbolic” quantities (i.e., visually/auditorily-presented digits). The results confirmed the facilitation of correspondences on WM performance, highlighting that the effect arises when the correspondence is at the target display, thus affecting response selection. Moreover, the experiment revealed modal differences in the effect, showing how symbolic information affects the auditory and visual modalities differently. Overall, these findings highlight the impact of crossmodal correspondences on WM processing, adding new light on the link between perceptual and post-perceptual stages of human information processing. |
| spellingShingle | Brunetti, R Indraccolo, I Mastroberardino, S Spence, C Santangelo, V The Impact of Cross-modal Correspondences on Working Memory Performance |
| title | The Impact of Cross-modal Correspondences on Working Memory Performance |
| title_full | The Impact of Cross-modal Correspondences on Working Memory Performance |
| title_fullStr | The Impact of Cross-modal Correspondences on Working Memory Performance |
| title_full_unstemmed | The Impact of Cross-modal Correspondences on Working Memory Performance |
| title_short | The Impact of Cross-modal Correspondences on Working Memory Performance |
| title_sort | impact of cross modal correspondences on working memory performance |
| work_keys_str_mv | AT brunettir theimpactofcrossmodalcorrespondencesonworkingmemoryperformance AT indraccoloi theimpactofcrossmodalcorrespondencesonworkingmemoryperformance AT mastroberardinos theimpactofcrossmodalcorrespondencesonworkingmemoryperformance AT spencec theimpactofcrossmodalcorrespondencesonworkingmemoryperformance AT santangelov theimpactofcrossmodalcorrespondencesonworkingmemoryperformance AT brunettir impactofcrossmodalcorrespondencesonworkingmemoryperformance AT indraccoloi impactofcrossmodalcorrespondencesonworkingmemoryperformance AT mastroberardinos impactofcrossmodalcorrespondencesonworkingmemoryperformance AT spencec impactofcrossmodalcorrespondencesonworkingmemoryperformance AT santangelov impactofcrossmodalcorrespondencesonworkingmemoryperformance |