A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing
Humans show a unique capacity to process complex information from multiple sources. Social perception in natural environment provides a good example of such capacity as it typically requires the integration of information from different sensory systems, and also from different levels of sensory proc...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2018-04-01
|
| Series: | Frontiers in Human Neuroscience |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/article/10.3389/fnhum.2018.00153/full |
| _version_ | 1818411953227300864 |
|---|---|
| author | Felipe Pegado Felipe Pegado Felipe Pegado Michelle H. A. Hendriks Michelle H. A. Hendriks Steffie Amelynck Nicky Daniels Jessica Bulthé Haemy Lee Masson Bart Boets Bart Boets Hans Op de Beeck |
| author_facet | Felipe Pegado Felipe Pegado Felipe Pegado Michelle H. A. Hendriks Michelle H. A. Hendriks Steffie Amelynck Nicky Daniels Jessica Bulthé Haemy Lee Masson Bart Boets Bart Boets Hans Op de Beeck |
| author_sort | Felipe Pegado |
| collection | DOAJ |
| description | Humans show a unique capacity to process complex information from multiple sources. Social perception in natural environment provides a good example of such capacity as it typically requires the integration of information from different sensory systems, and also from different levels of sensory processing. Here, instead of studying one isolate system and level of representation, we focused upon a neuroimaging paradigm which allows to capture multiple brain representations simultaneously, i.e., low and high-level processing in two different sensory systems, as well as abstract cognitive processing of congruency. Subjects performed social decisions based on the congruency between auditory and visual processing. Using multivoxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data, we probed a wide variety of representations. Our results confirmed the expected representations at each level and system according to the literature. Further, beyond the hierarchical organization of the visual, auditory and higher order neural systems, we provide a more nuanced picture of the brain functional architecture. Indeed, brain regions of the same neural system show similarity in their representations, but they also share information with regions from other systems. Further, the strength of neural information varied considerably across domains in a way that was not obviously related to task relevance. For instance, selectivity for task-irrelevant animacy of visual input was very strong. The present approach represents a new way to explore the richness of co-activated brain representations underlying the natural complexity in human cognition. |
| first_indexed | 2024-12-14T10:39:36Z |
| format | Article |
| id | doaj.art-8ae663d1abfa4049bcf0a03b519b40f6 |
| institution | Directory Open Access Journal |
| issn | 1662-5161 |
| language | English |
| last_indexed | 2024-12-14T10:39:36Z |
| publishDate | 2018-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Human Neuroscience |
| spelling | doaj.art-8ae663d1abfa4049bcf0a03b519b40f62022-12-21T23:05:45ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612018-04-011210.3389/fnhum.2018.00153338861A Multitude of Neural Representations Behind Multisensory “Social Norm” ProcessingFelipe Pegado0Felipe Pegado1Felipe Pegado2Michelle H. A. Hendriks3Michelle H. A. Hendriks4Steffie Amelynck5Nicky Daniels6Jessica Bulthé7Haemy Lee Masson8Bart Boets9Bart Boets10Hans Op de Beeck11Department of Brain and Cognition, KU Leuven, Leuven, BelgiumCenter for Developmental Psychiatry, Department of Neurosciences, KU Leuven, Leuven, BelgiumLeuven Autism Research Consortium, KU Leuven, Leuven, BelgiumDepartment of Brain and Cognition, KU Leuven, Leuven, BelgiumLeuven Autism Research Consortium, KU Leuven, Leuven, BelgiumDepartment of Brain and Cognition, KU Leuven, Leuven, BelgiumDepartment of Brain and Cognition, KU Leuven, Leuven, BelgiumDepartment of Brain and Cognition, KU Leuven, Leuven, BelgiumDepartment of Brain and Cognition, KU Leuven, Leuven, BelgiumCenter for Developmental Psychiatry, Department of Neurosciences, KU Leuven, Leuven, BelgiumLeuven Autism Research Consortium, KU Leuven, Leuven, BelgiumDepartment of Brain and Cognition, KU Leuven, Leuven, BelgiumHumans show a unique capacity to process complex information from multiple sources. Social perception in natural environment provides a good example of such capacity as it typically requires the integration of information from different sensory systems, and also from different levels of sensory processing. Here, instead of studying one isolate system and level of representation, we focused upon a neuroimaging paradigm which allows to capture multiple brain representations simultaneously, i.e., low and high-level processing in two different sensory systems, as well as abstract cognitive processing of congruency. Subjects performed social decisions based on the congruency between auditory and visual processing. Using multivoxel pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data, we probed a wide variety of representations. Our results confirmed the expected representations at each level and system according to the literature. Further, beyond the hierarchical organization of the visual, auditory and higher order neural systems, we provide a more nuanced picture of the brain functional architecture. Indeed, brain regions of the same neural system show similarity in their representations, but they also share information with regions from other systems. Further, the strength of neural information varied considerably across domains in a way that was not obviously related to task relevance. For instance, selectivity for task-irrelevant animacy of visual input was very strong. The present approach represents a new way to explore the richness of co-activated brain representations underlying the natural complexity in human cognition.http://journal.frontiersin.org/article/10.3389/fnhum.2018.00153/fullmultisensoryaudio-visualmultivoxel pattern analysisorthogonal designhierarchical brainsocial norm |
| spellingShingle | Felipe Pegado Felipe Pegado Felipe Pegado Michelle H. A. Hendriks Michelle H. A. Hendriks Steffie Amelynck Nicky Daniels Jessica Bulthé Haemy Lee Masson Bart Boets Bart Boets Hans Op de Beeck A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing Frontiers in Human Neuroscience multisensory audio-visual multivoxel pattern analysis orthogonal design hierarchical brain social norm |
| title | A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing |
| title_full | A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing |
| title_fullStr | A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing |
| title_full_unstemmed | A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing |
| title_short | A Multitude of Neural Representations Behind Multisensory “Social Norm” Processing |
| title_sort | multitude of neural representations behind multisensory social norm processing |
| topic | multisensory audio-visual multivoxel pattern analysis orthogonal design hierarchical brain social norm |
| url | http://journal.frontiersin.org/article/10.3389/fnhum.2018.00153/full |
| work_keys_str_mv | AT felipepegado amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT felipepegado amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT felipepegado amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT michellehahendriks amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT michellehahendriks amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT steffieamelynck amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT nickydaniels amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT jessicabulthe amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT haemyleemasson amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT bartboets amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT bartboets amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT hansopdebeeck amultitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT felipepegado multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT felipepegado multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT felipepegado multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT michellehahendriks multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT michellehahendriks multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT steffieamelynck multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT nickydaniels multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT jessicabulthe multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT haemyleemasson multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT bartboets multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT bartboets multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing AT hansopdebeeck multitudeofneuralrepresentationsbehindmultisensorysocialnormprocessing |