Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
Social interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce’s Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional...
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2018-08-01
|
Series: | Frontiers in Human Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/article/10.3389/fnhum.2018.00296/full |
_version_ | 1819050154180739072 |
---|---|
author | Dhana Wolf Dhana Wolf Irene Mittelberg Irene Mittelberg Linn-Marlen Rekittke Linn-Marlen Rekittke Saurabh Bhavsar Mikhail Zvyagintsev Mikhail Zvyagintsev Annina Haeck Fengyu Cong Martin Klasen Klaus Mathiak Klaus Mathiak Klaus Mathiak |
author_facet | Dhana Wolf Dhana Wolf Irene Mittelberg Irene Mittelberg Linn-Marlen Rekittke Linn-Marlen Rekittke Saurabh Bhavsar Mikhail Zvyagintsev Mikhail Zvyagintsev Annina Haeck Fengyu Cong Martin Klasen Klaus Mathiak Klaus Mathiak Klaus Mathiak |
author_sort | Dhana Wolf |
collection | DOAJ |
description | Social interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce’s Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional magnetic resonance imaging (fMRI), 16 volunteers watched a movie narrative encompassing verbal and non-verbal social interactions. Three types of non-verbal interactions were coded (“unresolved,” “non-habitual,” and “habitual”) based on a typology reflecting Peirce’s UCs. As expected, the auditory cortex responded to verbal interactions, but non-verbal interactions modulated temporal areas as well. Conceivably, when speech was lacking, ambiguous visual information (unresolved interactions) primed auditory processing in contrast to learned behavioral patterns (habitual interactions). The latter recruited a parahippocampal-occipital network supporting conceptual processing and associative memory retrieval. Requesting semiotic contextualization, non-habitual interactions activated visuo-spatial and contextual rule-learning areas such as the temporo-parietal junction and right lateral prefrontal cortex. In summary, the cognitive-semiotic typology reflected distinct sensory and association networks underlying the interpretation of observed non-verbal social interactions. |
first_indexed | 2024-12-21T11:43:32Z |
format | Article |
id | doaj.art-6482bc71936f418fa826d720ab3f79df |
institution | Directory Open Access Journal |
issn | 1662-5161 |
language | English |
last_indexed | 2024-12-21T11:43:32Z |
publishDate | 2018-08-01 |
publisher | Frontiers Media S.A. |
record_format | Article |
series | Frontiers in Human Neuroscience |
spelling | doaj.art-6482bc71936f418fa826d720ab3f79df2022-12-21T19:05:14ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612018-08-011210.3389/fnhum.2018.00296372313Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic ViewingDhana Wolf0Dhana Wolf1Irene Mittelberg2Irene Mittelberg3Linn-Marlen Rekittke4Linn-Marlen Rekittke5Saurabh Bhavsar6Mikhail Zvyagintsev7Mikhail Zvyagintsev8Annina Haeck9Fengyu Cong10Martin Klasen11Klaus Mathiak12Klaus Mathiak13Klaus Mathiak14Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyNatural Media Lab, Human Technology Centre (HumTec), RWTH Aachen University, Aachen, GermanyNatural Media Lab, Human Technology Centre (HumTec), RWTH Aachen University, Aachen, GermanyCenter for Sign Language and Gesture (SignGes), RWTH Aachen University, Aachen, GermanyNatural Media Lab, Human Technology Centre (HumTec), RWTH Aachen University, Aachen, GermanyCenter for Sign Language and Gesture (SignGes), RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyBrain Imaging Facility, Interdisciplinary Centre for Clinical Studies (IZKF), Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian, ChinaDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyCenter for Sign Language and Gesture (SignGes), RWTH Aachen University, Aachen, GermanyJARA-Translational Brain Medicine, Aachen, GermanySocial interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce’s Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional magnetic resonance imaging (fMRI), 16 volunteers watched a movie narrative encompassing verbal and non-verbal social interactions. Three types of non-verbal interactions were coded (“unresolved,” “non-habitual,” and “habitual”) based on a typology reflecting Peirce’s UCs. As expected, the auditory cortex responded to verbal interactions, but non-verbal interactions modulated temporal areas as well. Conceivably, when speech was lacking, ambiguous visual information (unresolved interactions) primed auditory processing in contrast to learned behavioral patterns (habitual interactions). The latter recruited a parahippocampal-occipital network supporting conceptual processing and associative memory retrieval. Requesting semiotic contextualization, non-habitual interactions activated visuo-spatial and contextual rule-learning areas such as the temporo-parietal junction and right lateral prefrontal cortex. In summary, the cognitive-semiotic typology reflected distinct sensory and association networks underlying the interpretation of observed non-verbal social interactions.https://www.frontiersin.org/article/10.3389/fnhum.2018.00296/fullsocial cognitive neurosciencenatural film viewingfunctional imagingsemioticssocial interaction |
spellingShingle | Dhana Wolf Dhana Wolf Irene Mittelberg Irene Mittelberg Linn-Marlen Rekittke Linn-Marlen Rekittke Saurabh Bhavsar Mikhail Zvyagintsev Mikhail Zvyagintsev Annina Haeck Fengyu Cong Martin Klasen Klaus Mathiak Klaus Mathiak Klaus Mathiak Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing Frontiers in Human Neuroscience social cognitive neuroscience natural film viewing functional imaging semiotics social interaction |
title | Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing |
title_full | Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing |
title_fullStr | Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing |
title_full_unstemmed | Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing |
title_short | Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing |
title_sort | interpretation of social interactions functional imaging of cognitive semiotic categories during naturalistic viewing |
topic | social cognitive neuroscience natural film viewing functional imaging semiotics social interaction |
url | https://www.frontiersin.org/article/10.3389/fnhum.2018.00296/full |
work_keys_str_mv | AT dhanawolf interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT dhanawolf interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT irenemittelberg interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT irenemittelberg interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT linnmarlenrekittke interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT linnmarlenrekittke interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT saurabhbhavsar interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT mikhailzvyagintsev interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT mikhailzvyagintsev interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT anninahaeck interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT fengyucong interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT martinklasen interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT klausmathiak interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT klausmathiak interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing AT klausmathiak interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing |