Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval

Although evidence has shown that working memory (WM) can be differentially affected by the multisensory congruency of different visual and auditory stimuli, it remains unclear whether different multisensory congruency about concrete and abstract words could impact further WM retrieval. By manipulati...

Full description

Bibliographic Details
Main Authors: Jia Cheng, Jingjing Li, Aijun Wang, Ming Zhang
Format: Article
Language:English
Published: MDPI AG 2023-05-01
Series:Brain Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3425/13/5/811
_version_ 1797600770738094080
author Jia Cheng
Jingjing Li
Aijun Wang
Ming Zhang
author_facet Jia Cheng
Jingjing Li
Aijun Wang
Ming Zhang
author_sort Jia Cheng
collection DOAJ
description Although evidence has shown that working memory (WM) can be differentially affected by the multisensory congruency of different visual and auditory stimuli, it remains unclear whether different multisensory congruency about concrete and abstract words could impact further WM retrieval. By manipulating the attention focus toward different matching conditions of visual and auditory word characteristics in a 2-back paradigm, the present study revealed that for the characteristically incongruent condition under the auditory retrieval condition, the response to abstract words was faster than that to concrete words, indicating that auditory abstract words are not affected by visual representation, while auditory concrete words are. Alternatively, for concrete words under the visual retrieval condition, WM retrieval was faster in the characteristically incongruent condition than in the characteristically congruent condition, indicating that visual representation formed by auditory concrete words may interfere with WM retrieval of visual concrete words. The present findings demonstrated that concrete words in multisensory conditions may be too aggressively encoded with other visual representations, which would inadvertently slow WM retrieval. However, abstract words seem to suppress interference better, showing better WM performance than concrete words in the multisensory condition.
first_indexed 2024-03-11T03:53:40Z
format Article
id doaj.art-52e66af2b4e64506a769975bcfa91351
institution Directory Open Access Journal
issn 2076-3425
language English
last_indexed 2024-03-11T03:53:40Z
publishDate 2023-05-01
publisher MDPI AG
record_format Article
series Brain Sciences
spelling doaj.art-52e66af2b4e64506a769975bcfa913512023-11-18T00:43:12ZengMDPI AGBrain Sciences2076-34252023-05-0113581110.3390/brainsci13050811Semantic Bimodal Presentation Differentially Slows Working Memory RetrievalJia Cheng0Jingjing Li1Aijun Wang2Ming Zhang3Department of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou 215123, ChinaDepartment of Psychology, Suzhou University of Science and Technology, Suzhou 215009, ChinaAlthough evidence has shown that working memory (WM) can be differentially affected by the multisensory congruency of different visual and auditory stimuli, it remains unclear whether different multisensory congruency about concrete and abstract words could impact further WM retrieval. By manipulating the attention focus toward different matching conditions of visual and auditory word characteristics in a 2-back paradigm, the present study revealed that for the characteristically incongruent condition under the auditory retrieval condition, the response to abstract words was faster than that to concrete words, indicating that auditory abstract words are not affected by visual representation, while auditory concrete words are. Alternatively, for concrete words under the visual retrieval condition, WM retrieval was faster in the characteristically incongruent condition than in the characteristically congruent condition, indicating that visual representation formed by auditory concrete words may interfere with WM retrieval of visual concrete words. The present findings demonstrated that concrete words in multisensory conditions may be too aggressively encoded with other visual representations, which would inadvertently slow WM retrieval. However, abstract words seem to suppress interference better, showing better WM performance than concrete words in the multisensory condition.https://www.mdpi.com/2076-3425/13/5/811multisensory congruencybimodal n-backconcrete wordsabstract wordsworking memorymodal representations
spellingShingle Jia Cheng
Jingjing Li
Aijun Wang
Ming Zhang
Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval
Brain Sciences
multisensory congruency
bimodal n-back
concrete words
abstract words
working memory
modal representations
title Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval
title_full Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval
title_fullStr Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval
title_full_unstemmed Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval
title_short Semantic Bimodal Presentation Differentially Slows Working Memory Retrieval
title_sort semantic bimodal presentation differentially slows working memory retrieval
topic multisensory congruency
bimodal n-back
concrete words
abstract words
working memory
modal representations
url https://www.mdpi.com/2076-3425/13/5/811
work_keys_str_mv AT jiacheng semanticbimodalpresentationdifferentiallyslowsworkingmemoryretrieval
AT jingjingli semanticbimodalpresentationdifferentiallyslowsworkingmemoryretrieval
AT aijunwang semanticbimodalpresentationdifferentiallyslowsworkingmemoryretrieval
AT mingzhang semanticbimodalpresentationdifferentiallyslowsworkingmemoryretrieval