Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
This paper presents three empirical studies that unravel how the devices of multimodal cohesion support viewers' narrative interpretation of scene transitions in film. The linguistics-informed method of cohesion analysis in film uncovers the establishment of cohesive ties between characters, ob...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2024-03-01
|
Series: | Frontiers in Communication |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/fcomm.2024.1347788/full |
_version_ | 1797238487732191232 |
---|---|
author | Dayana Markhabayeva Chiao-I Tseng |
author_facet | Dayana Markhabayeva Chiao-I Tseng |
author_sort | Dayana Markhabayeva |
collection | DOAJ |
description | This paper presents three empirical studies that unravel how the devices of multimodal cohesion support viewers' narrative interpretation of scene transitions in film. The linguistics-informed method of cohesion analysis in film uncovers the establishment of cohesive ties between characters, objects, settings and characters' actions. Previous studies using eye-tracking and comprehension tests already indicate the significance of multimodal cohesion in people's comprehension of background settings within a continuous scene. The present paper investigates further whether film cohesion impacts viewers' story comprehension across different scenes and settings. Moreover, it also explores whether the spatio-temporal relations between scenes is a significant factor, along with cohesive devices, in viewers' scene comprehension. Methodologically, we create contrasting film situations by manipulating cohesion structures and spatio-temporal orders of scenes. Our comparative analyses of viewers' comprehension of these different film situations reveal that the presence of cohesive cues significantly can influence viewers' accurate scene comprehension. Through testing the inter-relation of cohesion, spatio-temporal order, characters' intention and viewers' time perception, this paper offers new avenues for further exploration of space, time and coherence in film. |
first_indexed | 2024-04-24T17:36:26Z |
format | Article |
id | doaj.art-b05bae6074fd480ca2e5d41f91278aa7 |
institution | Directory Open Access Journal |
issn | 2297-900X |
language | English |
last_indexed | 2024-04-24T17:36:26Z |
publishDate | 2024-03-01 |
publisher | Frontiers Media S.A. |
record_format | Article |
series | Frontiers in Communication |
spelling | doaj.art-b05bae6074fd480ca2e5d41f91278aa72024-03-28T05:05:52ZengFrontiers Media S.A.Frontiers in Communication2297-900X2024-03-01910.3389/fcomm.2024.13477881347788Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigationDayana Markhabayeva0Chiao-I Tseng1Faculty of Linguistics and Literary Studies, University of Bremen, Bremen, GermanyDepartment of Applied Information Technology, University of Gothenburg, Gothenburg, SwedenThis paper presents three empirical studies that unravel how the devices of multimodal cohesion support viewers' narrative interpretation of scene transitions in film. The linguistics-informed method of cohesion analysis in film uncovers the establishment of cohesive ties between characters, objects, settings and characters' actions. Previous studies using eye-tracking and comprehension tests already indicate the significance of multimodal cohesion in people's comprehension of background settings within a continuous scene. The present paper investigates further whether film cohesion impacts viewers' story comprehension across different scenes and settings. Moreover, it also explores whether the spatio-temporal relations between scenes is a significant factor, along with cohesive devices, in viewers' scene comprehension. Methodologically, we create contrasting film situations by manipulating cohesion structures and spatio-temporal orders of scenes. Our comparative analyses of viewers' comprehension of these different film situations reveal that the presence of cohesive cues significantly can influence viewers' accurate scene comprehension. Through testing the inter-relation of cohesion, spatio-temporal order, characters' intention and viewers' time perception, this paper offers new avenues for further exploration of space, time and coherence in film.https://www.frontiersin.org/articles/10.3389/fcomm.2024.1347788/fullfilmcohesionscene transitionmultimodal discourse analysisnarrative comprehensionspatio-temporal relations |
spellingShingle | Dayana Markhabayeva Chiao-I Tseng Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation Frontiers in Communication film cohesion scene transition multimodal discourse analysis narrative comprehension spatio-temporal relations |
title | Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation |
title_full | Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation |
title_fullStr | Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation |
title_full_unstemmed | Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation |
title_short | Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation |
title_sort | multimodal cohesion and viewers comprehension of scene transitions in film an empirical investigation |
topic | film cohesion scene transition multimodal discourse analysis narrative comprehension spatio-temporal relations |
url | https://www.frontiersin.org/articles/10.3389/fcomm.2024.1347788/full |
work_keys_str_mv | AT dayanamarkhabayeva multimodalcohesionandviewerscomprehensionofscenetransitionsinfilmanempiricalinvestigation AT chiaoitseng multimodalcohesionandviewerscomprehensionofscenetransitionsinfilmanempiricalinvestigation |