Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing

Social interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce’s Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional...

Full description

Bibliographic Details
Main Authors: Dhana Wolf, Irene Mittelberg, Linn-Marlen Rekittke, Saurabh Bhavsar, Mikhail Zvyagintsev, Annina Haeck, Fengyu Cong, Martin Klasen, Klaus Mathiak
Format: Article
Language:English
Published: Frontiers Media S.A. 2018-08-01
Series:Frontiers in Human Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnhum.2018.00296/full
_version_ 1819050154180739072
author Dhana Wolf
Dhana Wolf
Irene Mittelberg
Irene Mittelberg
Linn-Marlen Rekittke
Linn-Marlen Rekittke
Saurabh Bhavsar
Mikhail Zvyagintsev
Mikhail Zvyagintsev
Annina Haeck
Fengyu Cong
Martin Klasen
Klaus Mathiak
Klaus Mathiak
Klaus Mathiak
author_facet Dhana Wolf
Dhana Wolf
Irene Mittelberg
Irene Mittelberg
Linn-Marlen Rekittke
Linn-Marlen Rekittke
Saurabh Bhavsar
Mikhail Zvyagintsev
Mikhail Zvyagintsev
Annina Haeck
Fengyu Cong
Martin Klasen
Klaus Mathiak
Klaus Mathiak
Klaus Mathiak
author_sort Dhana Wolf
collection DOAJ
description Social interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce’s Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional magnetic resonance imaging (fMRI), 16 volunteers watched a movie narrative encompassing verbal and non-verbal social interactions. Three types of non-verbal interactions were coded (“unresolved,” “non-habitual,” and “habitual”) based on a typology reflecting Peirce’s UCs. As expected, the auditory cortex responded to verbal interactions, but non-verbal interactions modulated temporal areas as well. Conceivably, when speech was lacking, ambiguous visual information (unresolved interactions) primed auditory processing in contrast to learned behavioral patterns (habitual interactions). The latter recruited a parahippocampal-occipital network supporting conceptual processing and associative memory retrieval. Requesting semiotic contextualization, non-habitual interactions activated visuo-spatial and contextual rule-learning areas such as the temporo-parietal junction and right lateral prefrontal cortex. In summary, the cognitive-semiotic typology reflected distinct sensory and association networks underlying the interpretation of observed non-verbal social interactions.
first_indexed 2024-12-21T11:43:32Z
format Article
id doaj.art-6482bc71936f418fa826d720ab3f79df
institution Directory Open Access Journal
issn 1662-5161
language English
last_indexed 2024-12-21T11:43:32Z
publishDate 2018-08-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Human Neuroscience
spelling doaj.art-6482bc71936f418fa826d720ab3f79df2022-12-21T19:05:14ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612018-08-011210.3389/fnhum.2018.00296372313Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic ViewingDhana Wolf0Dhana Wolf1Irene Mittelberg2Irene Mittelberg3Linn-Marlen Rekittke4Linn-Marlen Rekittke5Saurabh Bhavsar6Mikhail Zvyagintsev7Mikhail Zvyagintsev8Annina Haeck9Fengyu Cong10Martin Klasen11Klaus Mathiak12Klaus Mathiak13Klaus Mathiak14Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyNatural Media Lab, Human Technology Centre (HumTec), RWTH Aachen University, Aachen, GermanyNatural Media Lab, Human Technology Centre (HumTec), RWTH Aachen University, Aachen, GermanyCenter for Sign Language and Gesture (SignGes), RWTH Aachen University, Aachen, GermanyNatural Media Lab, Human Technology Centre (HumTec), RWTH Aachen University, Aachen, GermanyCenter for Sign Language and Gesture (SignGes), RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyBrain Imaging Facility, Interdisciplinary Centre for Clinical Studies (IZKF), Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian, ChinaDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyDepartment of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Aachen, GermanyCenter for Sign Language and Gesture (SignGes), RWTH Aachen University, Aachen, GermanyJARA-Translational Brain Medicine, Aachen, GermanySocial interactions arise from patterns of communicative signs, whose perception and interpretation require a multitude of cognitive functions. The semiotic framework of Peirce’s Universal Categories (UCs) laid ground for a novel cognitive-semiotic typology of social interactions. During functional magnetic resonance imaging (fMRI), 16 volunteers watched a movie narrative encompassing verbal and non-verbal social interactions. Three types of non-verbal interactions were coded (“unresolved,” “non-habitual,” and “habitual”) based on a typology reflecting Peirce’s UCs. As expected, the auditory cortex responded to verbal interactions, but non-verbal interactions modulated temporal areas as well. Conceivably, when speech was lacking, ambiguous visual information (unresolved interactions) primed auditory processing in contrast to learned behavioral patterns (habitual interactions). The latter recruited a parahippocampal-occipital network supporting conceptual processing and associative memory retrieval. Requesting semiotic contextualization, non-habitual interactions activated visuo-spatial and contextual rule-learning areas such as the temporo-parietal junction and right lateral prefrontal cortex. In summary, the cognitive-semiotic typology reflected distinct sensory and association networks underlying the interpretation of observed non-verbal social interactions.https://www.frontiersin.org/article/10.3389/fnhum.2018.00296/fullsocial cognitive neurosciencenatural film viewingfunctional imagingsemioticssocial interaction
spellingShingle Dhana Wolf
Dhana Wolf
Irene Mittelberg
Irene Mittelberg
Linn-Marlen Rekittke
Linn-Marlen Rekittke
Saurabh Bhavsar
Mikhail Zvyagintsev
Mikhail Zvyagintsev
Annina Haeck
Fengyu Cong
Martin Klasen
Klaus Mathiak
Klaus Mathiak
Klaus Mathiak
Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
Frontiers in Human Neuroscience
social cognitive neuroscience
natural film viewing
functional imaging
semiotics
social interaction
title Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
title_full Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
title_fullStr Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
title_full_unstemmed Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
title_short Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing
title_sort interpretation of social interactions functional imaging of cognitive semiotic categories during naturalistic viewing
topic social cognitive neuroscience
natural film viewing
functional imaging
semiotics
social interaction
url https://www.frontiersin.org/article/10.3389/fnhum.2018.00296/full
work_keys_str_mv AT dhanawolf interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT dhanawolf interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT irenemittelberg interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT irenemittelberg interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT linnmarlenrekittke interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT linnmarlenrekittke interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT saurabhbhavsar interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT mikhailzvyagintsev interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT mikhailzvyagintsev interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT anninahaeck interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT fengyucong interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT martinklasen interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT klausmathiak interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT klausmathiak interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing
AT klausmathiak interpretationofsocialinteractionsfunctionalimagingofcognitivesemioticcategoriesduringnaturalisticviewing