The role of semantic abstractness and perceptual category in processing speech accompanied by gestures
Space and shape are distinct perceptual categories. In language, perceptual information can also be used to describe abstract semantic concepts like a ‘rising income’ (space) or a ‘square personality’ (shape). Despite being inherently concrete, co-speech gestures depicting space and shape can accomp...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2013-12-01
|
| Series: | Frontiers in Behavioral Neuroscience |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/Journal/10.3389/fnbeh.2013.00181/full |
| _version_ | 1828486782836015104 |
|---|---|
| author | Arne eNagels Anjan eChatterjee TIlo eKircher Benjamin eStraube |
| author_facet | Arne eNagels Anjan eChatterjee TIlo eKircher Benjamin eStraube |
| author_sort | Arne eNagels |
| collection | DOAJ |
| description | Space and shape are distinct perceptual categories. In language, perceptual information can also be used to describe abstract semantic concepts like a ‘rising income’ (space) or a ‘square personality’ (shape). Despite being inherently concrete, co-speech gestures depicting space and shape can accompany concrete or abstract utterances. Here, we investigated the way that abstractness influences the neural processing of the perceptual categories of space and shape in gestures. Thus, we tested the hypothesis that the neural processing of perceptual categories is highly dependent on language context.In a two-factorial design, we investigated the neural basis for the processing of gestures containing shape (SH) and spatial information (SP) when accompanying concrete (c) or abstract (a) verbal utterances. During fMRI data acquisition participants were presented with short video clips of the four conditions (cSP, aSP, cSH, aSH) while performing an independent control task.Abstract (a) as opposed to concrete (c) utterances activated temporal lobes bilaterally and the left inferior frontal gyrus (IFG) for both shape-related (SH) and space-related (SP) utterances. An interaction of perceptual category and semantic abstractness in a more anterior part of the left IFG and inferior part of the posterior temporal lobe indicates that abstractness strongly influenced the neural processing of space and shape information. Despite the concrete visual input of co-speech gestures in all conditions, space and shape information is processed differently depending on the semantic abstractness of its linguistic context. |
| first_indexed | 2024-12-11T09:39:13Z |
| format | Article |
| id | doaj.art-c026f68a606d4c1784e6be7aa53e68df |
| institution | Directory Open Access Journal |
| issn | 1662-5153 |
| language | English |
| last_indexed | 2024-12-11T09:39:13Z |
| publishDate | 2013-12-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Behavioral Neuroscience |
| spelling | doaj.art-c026f68a606d4c1784e6be7aa53e68df2022-12-22T01:12:44ZengFrontiers Media S.A.Frontiers in Behavioral Neuroscience1662-51532013-12-01710.3389/fnbeh.2013.0018161557The role of semantic abstractness and perceptual category in processing speech accompanied by gesturesArne eNagels0Anjan eChatterjee1TIlo eKircher2Benjamin eStraube3Phillips UniversityUniversity of PennsylvaniaPhillips UniversityPhillips UniversitySpace and shape are distinct perceptual categories. In language, perceptual information can also be used to describe abstract semantic concepts like a ‘rising income’ (space) or a ‘square personality’ (shape). Despite being inherently concrete, co-speech gestures depicting space and shape can accompany concrete or abstract utterances. Here, we investigated the way that abstractness influences the neural processing of the perceptual categories of space and shape in gestures. Thus, we tested the hypothesis that the neural processing of perceptual categories is highly dependent on language context.In a two-factorial design, we investigated the neural basis for the processing of gestures containing shape (SH) and spatial information (SP) when accompanying concrete (c) or abstract (a) verbal utterances. During fMRI data acquisition participants were presented with short video clips of the four conditions (cSP, aSP, cSH, aSH) while performing an independent control task.Abstract (a) as opposed to concrete (c) utterances activated temporal lobes bilaterally and the left inferior frontal gyrus (IFG) for both shape-related (SH) and space-related (SP) utterances. An interaction of perceptual category and semantic abstractness in a more anterior part of the left IFG and inferior part of the posterior temporal lobe indicates that abstractness strongly influenced the neural processing of space and shape information. Despite the concrete visual input of co-speech gestures in all conditions, space and shape information is processed differently depending on the semantic abstractness of its linguistic context.http://journal.frontiersin.org/Journal/10.3389/fnbeh.2013.00181/fullCognitionfunctional magnetic resonance imagingiconic gesturesdeictic gesturesmetaphoric gesturesspeech-associated gestures |
| spellingShingle | Arne eNagels Anjan eChatterjee TIlo eKircher Benjamin eStraube The role of semantic abstractness and perceptual category in processing speech accompanied by gestures Frontiers in Behavioral Neuroscience Cognition functional magnetic resonance imaging iconic gestures deictic gestures metaphoric gestures speech-associated gestures |
| title | The role of semantic abstractness and perceptual category in processing speech accompanied by gestures |
| title_full | The role of semantic abstractness and perceptual category in processing speech accompanied by gestures |
| title_fullStr | The role of semantic abstractness and perceptual category in processing speech accompanied by gestures |
| title_full_unstemmed | The role of semantic abstractness and perceptual category in processing speech accompanied by gestures |
| title_short | The role of semantic abstractness and perceptual category in processing speech accompanied by gestures |
| title_sort | role of semantic abstractness and perceptual category in processing speech accompanied by gestures |
| topic | Cognition functional magnetic resonance imaging iconic gestures deictic gestures metaphoric gestures speech-associated gestures |
| url | http://journal.frontiersin.org/Journal/10.3389/fnbeh.2013.00181/full |
| work_keys_str_mv | AT arneenagels theroleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT anjanechatterjee theroleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT tiloekircher theroleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT benjaminestraube theroleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT arneenagels roleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT anjanechatterjee roleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT tiloekircher roleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures AT benjaminestraube roleofsemanticabstractnessandperceptualcategoryinprocessingspeechaccompaniedbygestures |