When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction
The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify a...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-02-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyg.2020.552533/full |
| _version_ | 1818650880996540416 |
|---|---|
| author | Hui-Chieh Hsu Geert Brône Kurt Feyaerts |
| author_facet | Hui-Chieh Hsu Geert Brône Kurt Feyaerts |
| author_sort | Hui-Chieh Hsu |
| collection | DOAJ |
| description | The framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. |
| first_indexed | 2024-12-17T01:57:15Z |
| format | Article |
| id | doaj.art-156b9bca43744e4eb2e2ca330d375fe1 |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-17T01:57:15Z |
| publishDate | 2021-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-156b9bca43744e4eb2e2ca330d375fe12022-12-21T22:07:56ZengFrontiers Media S.A.Frontiers in Psychology1664-10782021-02-011110.3389/fpsyg.2020.552533552533When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal InteractionHui-Chieh HsuGeert BrôneKurt FeyaertsThe framework of depicting put forward by Clark (2016) offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance.https://www.frontiersin.org/articles/10.3389/fpsyg.2020.552533/fulldepictionmultimodalitygestureiconicityembedding |
| spellingShingle | Hui-Chieh Hsu Geert Brône Kurt Feyaerts When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction Frontiers in Psychology depiction multimodality gesture iconicity embedding |
| title | When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction |
| title_full | When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction |
| title_fullStr | When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction |
| title_full_unstemmed | When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction |
| title_short | When Gesture “Takes Over”: Speech-Embedded Nonverbal Depictions in Multimodal Interaction |
| title_sort | when gesture takes over speech embedded nonverbal depictions in multimodal interaction |
| topic | depiction multimodality gesture iconicity embedding |
| url | https://www.frontiersin.org/articles/10.3389/fpsyg.2020.552533/full |
| work_keys_str_mv | AT huichiehhsu whengesturetakesoverspeechembeddednonverbaldepictionsinmultimodalinteraction AT geertbrone whengesturetakesoverspeechembeddednonverbaldepictionsinmultimodalinteraction AT kurtfeyaerts whengesturetakesoverspeechembeddednonverbaldepictionsinmultimodalinteraction |