Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation

This paper presents three empirical studies that unravel how the devices of multimodal cohesion support viewers' narrative interpretation of scene transitions in film. The linguistics-informed method of cohesion analysis in film uncovers the establishment of cohesive ties between characters, ob...

Full description

Bibliographic Details
Main Authors: Dayana Markhabayeva, Chiao-I Tseng
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-03-01
Series:Frontiers in Communication
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fcomm.2024.1347788/full
_version_ 1797238487732191232
author Dayana Markhabayeva
Chiao-I Tseng
author_facet Dayana Markhabayeva
Chiao-I Tseng
author_sort Dayana Markhabayeva
collection DOAJ
description This paper presents three empirical studies that unravel how the devices of multimodal cohesion support viewers' narrative interpretation of scene transitions in film. The linguistics-informed method of cohesion analysis in film uncovers the establishment of cohesive ties between characters, objects, settings and characters' actions. Previous studies using eye-tracking and comprehension tests already indicate the significance of multimodal cohesion in people's comprehension of background settings within a continuous scene. The present paper investigates further whether film cohesion impacts viewers' story comprehension across different scenes and settings. Moreover, it also explores whether the spatio-temporal relations between scenes is a significant factor, along with cohesive devices, in viewers' scene comprehension. Methodologically, we create contrasting film situations by manipulating cohesion structures and spatio-temporal orders of scenes. Our comparative analyses of viewers' comprehension of these different film situations reveal that the presence of cohesive cues significantly can influence viewers' accurate scene comprehension. Through testing the inter-relation of cohesion, spatio-temporal order, characters' intention and viewers' time perception, this paper offers new avenues for further exploration of space, time and coherence in film.
first_indexed 2024-04-24T17:36:26Z
format Article
id doaj.art-b05bae6074fd480ca2e5d41f91278aa7
institution Directory Open Access Journal
issn 2297-900X
language English
last_indexed 2024-04-24T17:36:26Z
publishDate 2024-03-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Communication
spelling doaj.art-b05bae6074fd480ca2e5d41f91278aa72024-03-28T05:05:52ZengFrontiers Media S.A.Frontiers in Communication2297-900X2024-03-01910.3389/fcomm.2024.13477881347788Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigationDayana Markhabayeva0Chiao-I Tseng1Faculty of Linguistics and Literary Studies, University of Bremen, Bremen, GermanyDepartment of Applied Information Technology, University of Gothenburg, Gothenburg, SwedenThis paper presents three empirical studies that unravel how the devices of multimodal cohesion support viewers' narrative interpretation of scene transitions in film. The linguistics-informed method of cohesion analysis in film uncovers the establishment of cohesive ties between characters, objects, settings and characters' actions. Previous studies using eye-tracking and comprehension tests already indicate the significance of multimodal cohesion in people's comprehension of background settings within a continuous scene. The present paper investigates further whether film cohesion impacts viewers' story comprehension across different scenes and settings. Moreover, it also explores whether the spatio-temporal relations between scenes is a significant factor, along with cohesive devices, in viewers' scene comprehension. Methodologically, we create contrasting film situations by manipulating cohesion structures and spatio-temporal orders of scenes. Our comparative analyses of viewers' comprehension of these different film situations reveal that the presence of cohesive cues significantly can influence viewers' accurate scene comprehension. Through testing the inter-relation of cohesion, spatio-temporal order, characters' intention and viewers' time perception, this paper offers new avenues for further exploration of space, time and coherence in film.https://www.frontiersin.org/articles/10.3389/fcomm.2024.1347788/fullfilmcohesionscene transitionmultimodal discourse analysisnarrative comprehensionspatio-temporal relations
spellingShingle Dayana Markhabayeva
Chiao-I Tseng
Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
Frontiers in Communication
film
cohesion
scene transition
multimodal discourse analysis
narrative comprehension
spatio-temporal relations
title Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
title_full Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
title_fullStr Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
title_full_unstemmed Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
title_short Multimodal cohesion and viewers' comprehension of scene transitions in film: an empirical investigation
title_sort multimodal cohesion and viewers comprehension of scene transitions in film an empirical investigation
topic film
cohesion
scene transition
multimodal discourse analysis
narrative comprehension
spatio-temporal relations
url https://www.frontiersin.org/articles/10.3389/fcomm.2024.1347788/full
work_keys_str_mv AT dayanamarkhabayeva multimodalcohesionandviewerscomprehensionofscenetransitionsinfilmanempiricalinvestigation
AT chiaoitseng multimodalcohesionandviewerscomprehensionofscenetransitionsinfilmanempiricalinvestigation