Categorical working memory codes in human visual cortex
Working memory contents are represented in neural activity patterns across multiple regions of the cortical hierarchy. A division of labor has been proposed where more anterior regions harbor increasingly abstract and categorical representations while the most detailed representations are held in pr...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-07-01
|
| Series: | NeuroImage |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1053811923003002 |
| _version_ | 1827947401351004160 |
|---|---|
| author | Chang Yan Thomas B. Christophel Carsten Allefeld John-Dylan Haynes |
| author_facet | Chang Yan Thomas B. Christophel Carsten Allefeld John-Dylan Haynes |
| author_sort | Chang Yan |
| collection | DOAJ |
| description | Working memory contents are represented in neural activity patterns across multiple regions of the cortical hierarchy. A division of labor has been proposed where more anterior regions harbor increasingly abstract and categorical representations while the most detailed representations are held in primary sensory cortices. Here, using fMRI and multivariate encoding modeling, we demonstrate that for color stimuli categorical codes are already present at the level of extrastriate visual cortex (V4 and VO1), even when subjects are neither implicitly nor explicitly encouraged to categorize the stimuli. Importantly, this categorical coding was observed during working memory, but not during perception. Thus, visual working memory is likely to rely at least in part on categorical representations. Significance statement: Working memory is the representational basis for human cognition. Recent work has demonstrated that numerous regions across the human brain can represent the contents of working memory. We use fMRI brain scanning and machine learning methods to demonstrate that different regions can represent the same content differently during working memory. Reading out the neural codes used to store working memory contents, we show that already in sensory cortex, areas V4 and VO1 represent color in a categorical format rather than a purely sensory fashion. Thereby, we provide a better understanding of how different regions of the brain might serve working memory and cognition. |
| first_indexed | 2024-04-09T12:39:25Z |
| format | Article |
| id | doaj.art-24a531a8c1124d30bf40396df7d0b5b8 |
| institution | Directory Open Access Journal |
| issn | 1095-9572 |
| language | English |
| last_indexed | 2024-04-09T12:39:25Z |
| publishDate | 2023-07-01 |
| publisher | Elsevier |
| record_format | Article |
| series | NeuroImage |
| spelling | doaj.art-24a531a8c1124d30bf40396df7d0b5b82023-05-15T04:13:57ZengElsevierNeuroImage1095-95722023-07-01274120149Categorical working memory codes in human visual cortexChang Yan0Thomas B. Christophel1Carsten Allefeld2John-Dylan Haynes3Bernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Philippstraße 13, Haus 6, 10115, GermanyBernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Philippstraße 13, Haus 6, 10115, Germany; Department of Psychology, Humboldt Universität zu Berlin, Rudower Chaussee 18, Berlin, 12489, Germany; Corresponding author.Department of Psychology, City, University of London, London EC1V 0HB, United KingdomBernstein Center for Computational Neuroscience and Berlin Center for Advanced Neuroimaging and Clinic for Neurology, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Philippstraße 13, Haus 6, 10115, Germany; Department of Psychology, Humboldt Universität zu Berlin, Rudower Chaussee 18, Berlin, 12489, Germany; Berlin School of Mind and Brain, Humboldt Universität, Berlin, Luisenstraße 56, Haus 1, Berlin, 10099, Germany; Cluster of Excellence NeuroCure, Charité Universitätsmedizin, corporate member of Freie Universität Berlin, Humboldt Universität zu Berlin, and Berlin Institute of Health, Berlin, Charitéplatz 1, Hufelandweg 14, Berlin, 10117, Germany; SFB 940 Volition and Cognitive Control, Technische Universität Dresden, Zellescher Weg 17, 01069 Dresden, GermanyWorking memory contents are represented in neural activity patterns across multiple regions of the cortical hierarchy. A division of labor has been proposed where more anterior regions harbor increasingly abstract and categorical representations while the most detailed representations are held in primary sensory cortices. Here, using fMRI and multivariate encoding modeling, we demonstrate that for color stimuli categorical codes are already present at the level of extrastriate visual cortex (V4 and VO1), even when subjects are neither implicitly nor explicitly encouraged to categorize the stimuli. Importantly, this categorical coding was observed during working memory, but not during perception. Thus, visual working memory is likely to rely at least in part on categorical representations. Significance statement: Working memory is the representational basis for human cognition. Recent work has demonstrated that numerous regions across the human brain can represent the contents of working memory. We use fMRI brain scanning and machine learning methods to demonstrate that different regions can represent the same content differently during working memory. Reading out the neural codes used to store working memory contents, we show that already in sensory cortex, areas V4 and VO1 represent color in a categorical format rather than a purely sensory fashion. Thereby, we provide a better understanding of how different regions of the brain might serve working memory and cognition.http://www.sciencedirect.com/science/article/pii/S1053811923003002ColorWorking memoryCategorical representationMultivariateEncoding modelingfMRI |
| spellingShingle | Chang Yan Thomas B. Christophel Carsten Allefeld John-Dylan Haynes Categorical working memory codes in human visual cortex NeuroImage Color Working memory Categorical representation Multivariate Encoding modeling fMRI |
| title | Categorical working memory codes in human visual cortex |
| title_full | Categorical working memory codes in human visual cortex |
| title_fullStr | Categorical working memory codes in human visual cortex |
| title_full_unstemmed | Categorical working memory codes in human visual cortex |
| title_short | Categorical working memory codes in human visual cortex |
| title_sort | categorical working memory codes in human visual cortex |
| topic | Color Working memory Categorical representation Multivariate Encoding modeling fMRI |
| url | http://www.sciencedirect.com/science/article/pii/S1053811923003002 |
| work_keys_str_mv | AT changyan categoricalworkingmemorycodesinhumanvisualcortex AT thomasbchristophel categoricalworkingmemorycodesinhumanvisualcortex AT carstenallefeld categoricalworkingmemorycodesinhumanvisualcortex AT johndylanhaynes categoricalworkingmemorycodesinhumanvisualcortex |