Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli.
One of the central questions in cognitive neuroscience is the precise neural representation, or brain pattern, associated with a semantic category. In this study, we explored the influence of audiovisual stimuli on the brain patterns of concepts or semantic categories through a functional magnetic r...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2011-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC3126799?pdf=render |
| _version_ | 1819131472552919040 |
|---|---|
| author | Yuanqing Li Guangyi Wang Jinyi Long Zhuliang Yu Biao Huang Xiaojian Li Tianyou Yu Changhong Liang Zheng Li Pei Sun |
| author_facet | Yuanqing Li Guangyi Wang Jinyi Long Zhuliang Yu Biao Huang Xiaojian Li Tianyou Yu Changhong Liang Zheng Li Pei Sun |
| author_sort | Yuanqing Li |
| collection | DOAJ |
| description | One of the central questions in cognitive neuroscience is the precise neural representation, or brain pattern, associated with a semantic category. In this study, we explored the influence of audiovisual stimuli on the brain patterns of concepts or semantic categories through a functional magnetic resonance imaging (fMRI) experiment. We used a pattern search method to extract brain patterns corresponding to two semantic categories: "old people" and "young people." These brain patterns were elicited by semantically congruent audiovisual, semantically incongruent audiovisual, unimodal visual, and unimodal auditory stimuli belonging to the two semantic categories. We calculated the reproducibility index, which measures the similarity of the patterns within the same category. We also decoded the semantic categories from these brain patterns. The decoding accuracy reflects the discriminability of the brain patterns between two categories. The results showed that both the reproducibility index of brain patterns and the decoding accuracy were significantly higher for semantically congruent audiovisual stimuli than for unimodal visual and unimodal auditory stimuli, while the semantically incongruent stimuli did not elicit brain patterns with significantly higher reproducibility index or decoding accuracy. Thus, the semantically congruent audiovisual stimuli enhanced the within-class reproducibility of brain patterns and the between-class discriminability of brain patterns, and facilitate neural representations of semantic categories or concepts. Furthermore, we analyzed the brain activity in superior temporal sulcus and middle temporal gyrus (STS/MTG). The strength of the fMRI signal and the reproducibility index were enhanced by the semantically congruent audiovisual stimuli. Our results support the use of the reproducibility index as a potential tool to supplement the fMRI signal amplitude for evaluating multimodal integration. |
| first_indexed | 2024-12-22T09:16:03Z |
| format | Article |
| id | doaj.art-14815057fe1d40f18105631673954867 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-22T09:16:03Z |
| publishDate | 2011-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-14815057fe1d40f181056316739548672022-12-21T18:31:19ZengPublic Library of Science (PLoS)PLoS ONE1932-62032011-01-0166e2080110.1371/journal.pone.0020801Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli.Yuanqing LiGuangyi WangJinyi LongZhuliang YuBiao HuangXiaojian LiTianyou YuChanghong LiangZheng LiPei SunOne of the central questions in cognitive neuroscience is the precise neural representation, or brain pattern, associated with a semantic category. In this study, we explored the influence of audiovisual stimuli on the brain patterns of concepts or semantic categories through a functional magnetic resonance imaging (fMRI) experiment. We used a pattern search method to extract brain patterns corresponding to two semantic categories: "old people" and "young people." These brain patterns were elicited by semantically congruent audiovisual, semantically incongruent audiovisual, unimodal visual, and unimodal auditory stimuli belonging to the two semantic categories. We calculated the reproducibility index, which measures the similarity of the patterns within the same category. We also decoded the semantic categories from these brain patterns. The decoding accuracy reflects the discriminability of the brain patterns between two categories. The results showed that both the reproducibility index of brain patterns and the decoding accuracy were significantly higher for semantically congruent audiovisual stimuli than for unimodal visual and unimodal auditory stimuli, while the semantically incongruent stimuli did not elicit brain patterns with significantly higher reproducibility index or decoding accuracy. Thus, the semantically congruent audiovisual stimuli enhanced the within-class reproducibility of brain patterns and the between-class discriminability of brain patterns, and facilitate neural representations of semantic categories or concepts. Furthermore, we analyzed the brain activity in superior temporal sulcus and middle temporal gyrus (STS/MTG). The strength of the fMRI signal and the reproducibility index were enhanced by the semantically congruent audiovisual stimuli. Our results support the use of the reproducibility index as a potential tool to supplement the fMRI signal amplitude for evaluating multimodal integration.http://europepmc.org/articles/PMC3126799?pdf=render |
| spellingShingle | Yuanqing Li Guangyi Wang Jinyi Long Zhuliang Yu Biao Huang Xiaojian Li Tianyou Yu Changhong Liang Zheng Li Pei Sun Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. PLoS ONE |
| title | Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. |
| title_full | Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. |
| title_fullStr | Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. |
| title_full_unstemmed | Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. |
| title_short | Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. |
| title_sort | reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli |
| url | http://europepmc.org/articles/PMC3126799?pdf=render |
| work_keys_str_mv | AT yuanqingli reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT guangyiwang reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT jinyilong reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT zhuliangyu reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT biaohuang reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT xiaojianli reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT tianyouyu reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT changhongliang reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT zhengli reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli AT peisun reproducibilityanddiscriminabilityofbrainpatternsofsemanticcategoriesenhancedbycongruentaudiovisualstimuli |