Mapping the dynamics of visual feature coding: Insights into perception and integration.

The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual feature coding, inter...

Full description

Bibliographic Details
Main Authors: Tijl Grootswagers, Amanda K Robinson, Sophia M Shatek, Thomas A Carlson
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2024-01-01
Series:PLoS Computational Biology
Online Access:https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011760&type=printable
_version_ 1826545892712251392
author Tijl Grootswagers
Amanda K Robinson
Sophia M Shatek
Thomas A Carlson
author_facet Tijl Grootswagers
Amanda K Robinson
Sophia M Shatek
Thomas A Carlson
author_sort Tijl Grootswagers
collection DOAJ
description The basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual feature coding, interactions, and their relationship to human perception, we investigated neural responses and perceptual similarity judgements to a large set of visual stimuli that varied parametrically along four feature dimensions. We measured neural responses using electroencephalography (N = 16) to 256 grating stimuli that varied in orientation, spatial frequency, contrast, and colour. We then mapped the response profiles of the neural coding of each visual feature and their interactions, and related these to independently obtained behavioural judgements of stimulus similarity. The results confirmed fundamental principles of feature coding in the visual system, such that all four features were processed simultaneously but differed in their dynamics, and there was distinctive conjunction coding for different combinations of features in the neural responses. Importantly, modelling of the behaviour revealed that every stimulus feature contributed to perceptual judgements, despite the untargeted nature of the behavioural task. Further, the relationship between neural coding and behaviour was evident from initial processing stages, signifying that the fundamental features, not just their interactions, contribute to perception. This study highlights the importance of understanding how feature coding progresses through the visual hierarchy and the relationship between different stages of processing and perception.
first_indexed 2024-03-08T12:07:22Z
format Article
id doaj.art-116b1dc2ec124dfa847298de24ffa114
institution Directory Open Access Journal
issn 1553-734X
1553-7358
language English
last_indexed 2025-03-14T05:25:05Z
publishDate 2024-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS Computational Biology
spelling doaj.art-116b1dc2ec124dfa847298de24ffa1142025-03-06T05:30:55ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582024-01-01201e101176010.1371/journal.pcbi.1011760Mapping the dynamics of visual feature coding: Insights into perception and integration.Tijl GrootswagersAmanda K RobinsonSophia M ShatekThomas A CarlsonThe basic computations performed in the human early visual cortex are the foundation for visual perception. While we know a lot about these computations, a key missing piece is how the coding of visual features relates to our perception of the environment. To investigate visual feature coding, interactions, and their relationship to human perception, we investigated neural responses and perceptual similarity judgements to a large set of visual stimuli that varied parametrically along four feature dimensions. We measured neural responses using electroencephalography (N = 16) to 256 grating stimuli that varied in orientation, spatial frequency, contrast, and colour. We then mapped the response profiles of the neural coding of each visual feature and their interactions, and related these to independently obtained behavioural judgements of stimulus similarity. The results confirmed fundamental principles of feature coding in the visual system, such that all four features were processed simultaneously but differed in their dynamics, and there was distinctive conjunction coding for different combinations of features in the neural responses. Importantly, modelling of the behaviour revealed that every stimulus feature contributed to perceptual judgements, despite the untargeted nature of the behavioural task. Further, the relationship between neural coding and behaviour was evident from initial processing stages, signifying that the fundamental features, not just their interactions, contribute to perception. This study highlights the importance of understanding how feature coding progresses through the visual hierarchy and the relationship between different stages of processing and perception.https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011760&type=printable
spellingShingle Tijl Grootswagers
Amanda K Robinson
Sophia M Shatek
Thomas A Carlson
Mapping the dynamics of visual feature coding: Insights into perception and integration.
PLoS Computational Biology
title Mapping the dynamics of visual feature coding: Insights into perception and integration.
title_full Mapping the dynamics of visual feature coding: Insights into perception and integration.
title_fullStr Mapping the dynamics of visual feature coding: Insights into perception and integration.
title_full_unstemmed Mapping the dynamics of visual feature coding: Insights into perception and integration.
title_short Mapping the dynamics of visual feature coding: Insights into perception and integration.
title_sort mapping the dynamics of visual feature coding insights into perception and integration
url https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1011760&type=printable
work_keys_str_mv AT tijlgrootswagers mappingthedynamicsofvisualfeaturecodinginsightsintoperceptionandintegration
AT amandakrobinson mappingthedynamicsofvisualfeaturecodinginsightsintoperceptionandintegration
AT sophiamshatek mappingthedynamicsofvisualfeaturecodinginsightsintoperceptionandintegration
AT thomasacarlson mappingthedynamicsofvisualfeaturecodinginsightsintoperceptionandintegration