Gradual progression from sensory to task-related processing in cerebral cortex

Somewhere along the cortical hierarchy, behaviorally relevant information is distilled from raw sensory inputs. We examined how this transformation progresses along multiple levels of the hierarchy by comparing neural representations in visual, temporal, parietal, and frontal cortices in monkeys cat...

Full description

Bibliographic Details
Main Authors: von Nicolai, Constantin, Brincat, Scott Louis, Siegel, Markus, Miller, Earl K
Other Authors: Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
Format: Article
Published: National Academy of Sciences (U.S.) 2019
Online Access:http://hdl.handle.net/1721.1/120717
_version_ 1811079625657286656
author von Nicolai, Constantin
Brincat, Scott Louis
Siegel, Markus
Miller, Earl K
author2 Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
author_facet Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences
von Nicolai, Constantin
Brincat, Scott Louis
Siegel, Markus
Miller, Earl K
author_sort von Nicolai, Constantin
collection MIT
description Somewhere along the cortical hierarchy, behaviorally relevant information is distilled from raw sensory inputs. We examined how this transformation progresses along multiple levels of the hierarchy by comparing neural representations in visual, temporal, parietal, and frontal cortices in monkeys categorizing across three visual domains (shape, motion direction, and color). Representations in visual areas middle temporal (MT) and V4 were tightly linked to external sensory inputs. In contrast, lateral prefrontal cortex (PFC) largely represented the abstracted behavioral relevance of stimuli (task rule, motion category, and color category). Intermediate-level areas, including posterior inferotemporal (PIT), lateral intraparietal (LIP), and frontal eye fields (FEF), exhibited mixed representations. While the distribution of sensory information across areas aligned well with classical functional divisions (MT carried stronger motion information, and V4 and PIT carried stronger color and shape information), categorical abstraction did not, suggesting these areas may participate in different networks for stimulus-driven and cognitive functions. Paralleling these representational differences, the dimensionality of neural population activity decreased progressively from sensory to intermediate to frontal cortex. This shows how raw sensory representations are transformed into behaviorally relevant abstractions and suggests that the dimensionality of neural activity in higher cortical regions may be specific to their current task. Keywords: categorization; cognition; prefrontal cortex; posterior parietal cortex; dimensionality
first_indexed 2024-09-23T11:18:02Z
format Article
id mit-1721.1/120717
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T11:18:02Z
publishDate 2019
publisher National Academy of Sciences (U.S.)
record_format dspace
spelling mit-1721.1/1207172022-10-01T02:40:59Z Gradual progression from sensory to task-related processing in cerebral cortex von Nicolai, Constantin Brincat, Scott Louis Siegel, Markus Miller, Earl K Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Picower Institute for Learning and Memory Brincat, Scott Louis Siegel, Markus Miller, Earl K Somewhere along the cortical hierarchy, behaviorally relevant information is distilled from raw sensory inputs. We examined how this transformation progresses along multiple levels of the hierarchy by comparing neural representations in visual, temporal, parietal, and frontal cortices in monkeys categorizing across three visual domains (shape, motion direction, and color). Representations in visual areas middle temporal (MT) and V4 were tightly linked to external sensory inputs. In contrast, lateral prefrontal cortex (PFC) largely represented the abstracted behavioral relevance of stimuli (task rule, motion category, and color category). Intermediate-level areas, including posterior inferotemporal (PIT), lateral intraparietal (LIP), and frontal eye fields (FEF), exhibited mixed representations. While the distribution of sensory information across areas aligned well with classical functional divisions (MT carried stronger motion information, and V4 and PIT carried stronger color and shape information), categorical abstraction did not, suggesting these areas may participate in different networks for stimulus-driven and cognitive functions. Paralleling these representational differences, the dimensionality of neural population activity decreased progressively from sensory to intermediate to frontal cortex. This shows how raw sensory representations are transformed into behaviorally relevant abstractions and suggests that the dimensionality of neural activity in higher cortical regions may be specific to their current task. Keywords: categorization; cognition; prefrontal cortex; posterior parietal cortex; dimensionality National Institute of Mental Health (U.S.) (Grant 5R37MH087027) 2019-03-04T21:33:42Z 2019-03-04T21:33:42Z 2018-07 2017-09 2019-02-08T18:31:02Z Article http://purl.org/eprint/type/JournalArticle 0027-8424 1091-6490 http://hdl.handle.net/1721.1/120717 Brincat, Scott L. et al. “Gradual Progression from Sensory to Task-Related Processing in Cerebral Cortex.” Proceedings of the National Academy of Sciences 115, 30 (July 2018): E7202–E7211 © 2018 National Academy of Sciences http://dx.doi.org/10.1073/pnas.1717075115 Proceedings of the National Academy of Sciences Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf National Academy of Sciences (U.S.) PNAS
spellingShingle von Nicolai, Constantin
Brincat, Scott Louis
Siegel, Markus
Miller, Earl K
Gradual progression from sensory to task-related processing in cerebral cortex
title Gradual progression from sensory to task-related processing in cerebral cortex
title_full Gradual progression from sensory to task-related processing in cerebral cortex
title_fullStr Gradual progression from sensory to task-related processing in cerebral cortex
title_full_unstemmed Gradual progression from sensory to task-related processing in cerebral cortex
title_short Gradual progression from sensory to task-related processing in cerebral cortex
title_sort gradual progression from sensory to task related processing in cerebral cortex
url http://hdl.handle.net/1721.1/120717
work_keys_str_mv AT vonnicolaiconstantin gradualprogressionfromsensorytotaskrelatedprocessingincerebralcortex
AT brincatscottlouis gradualprogressionfromsensorytotaskrelatedprocessingincerebralcortex
AT siegelmarkus gradualprogressionfromsensorytotaskrelatedprocessingincerebralcortex
AT millerearlk gradualprogressionfromsensorytotaskrelatedprocessingincerebralcortex