Picture this: A review of research relating to narrative processing by moving image versus language
Reading fiction for pleasure is robustly correlated with improved cognitive attainment and other benefits. It is also in decline among young people in developed nations, in part because of competition from moving image fiction. We review existing research on the differences between reading or hearin...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Journal article |
| Published: |
Frontiers Media
2019
|
| _version_ | 1797091364460036096 |
|---|---|
| author | Jajdelska, E Anderson, M Butler, C Fabb, N Finnigan, E Garwood, I Kelly, S Kirk, W Kukkonen, K Mullally, S Schwan, S |
| author_facet | Jajdelska, E Anderson, M Butler, C Fabb, N Finnigan, E Garwood, I Kelly, S Kirk, W Kukkonen, K Mullally, S Schwan, S |
| author_sort | Jajdelska, E |
| collection | OXFORD |
| description | Reading fiction for pleasure is robustly correlated with improved cognitive attainment and other benefits. It is also in decline among young people in developed nations, in part because of competition from moving image fiction. We review existing research on the differences between reading or hearing verbal fiction and watching moving image fiction, as well as looking more broadly at research on image or text interactions and visual versus verbal processing. We conclude that verbal narrative generates more diverse responses than moving image narrative. We note that reading and viewing narrative are different tasks, with different cognitive loads. Viewing moving image narrative mostly involves visual processing with some working memory engagement, whereas reading narrative involves verbal processing, visual imagery, and personal memory (Xu et al., 2005). Attempts to compare the two by creating equivalent stimuli and task demands face a number of challenges. We discuss the difficulties of such comparative approaches. We then investigate the possibility of identifying lower level processing mechanisms that might distinguish cognition of the two media and propose internal scene construction and working memory as foci for future research. Although many of the sources we draw on concentrate on English-speaking participants in European or North American settings, we also cover material relating to speakers of Dutch, German, Hebrew, and Japanese in their respective countries, and studies of a remote Turkish mountain community. |
| first_indexed | 2024-03-07T03:31:57Z |
| format | Journal article |
| id | oxford-uuid:bb0770c6-ce6e-42df-9493-f981f581d80e |
| institution | University of Oxford |
| last_indexed | 2024-03-07T03:31:57Z |
| publishDate | 2019 |
| publisher | Frontiers Media |
| record_format | dspace |
| spelling | oxford-uuid:bb0770c6-ce6e-42df-9493-f981f581d80e2022-03-27T05:14:00ZPicture this: A review of research relating to narrative processing by moving image versus languageJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:bb0770c6-ce6e-42df-9493-f981f581d80eSymplectic Elements at OxfordFrontiers Media2019Jajdelska, EAnderson, MButler, CFabb, NFinnigan, EGarwood, IKelly, SKirk, WKukkonen, KMullally, SSchwan, SReading fiction for pleasure is robustly correlated with improved cognitive attainment and other benefits. It is also in decline among young people in developed nations, in part because of competition from moving image fiction. We review existing research on the differences between reading or hearing verbal fiction and watching moving image fiction, as well as looking more broadly at research on image or text interactions and visual versus verbal processing. We conclude that verbal narrative generates more diverse responses than moving image narrative. We note that reading and viewing narrative are different tasks, with different cognitive loads. Viewing moving image narrative mostly involves visual processing with some working memory engagement, whereas reading narrative involves verbal processing, visual imagery, and personal memory (Xu et al., 2005). Attempts to compare the two by creating equivalent stimuli and task demands face a number of challenges. We discuss the difficulties of such comparative approaches. We then investigate the possibility of identifying lower level processing mechanisms that might distinguish cognition of the two media and propose internal scene construction and working memory as foci for future research. Although many of the sources we draw on concentrate on English-speaking participants in European or North American settings, we also cover material relating to speakers of Dutch, German, Hebrew, and Japanese in their respective countries, and studies of a remote Turkish mountain community. |
| spellingShingle | Jajdelska, E Anderson, M Butler, C Fabb, N Finnigan, E Garwood, I Kelly, S Kirk, W Kukkonen, K Mullally, S Schwan, S Picture this: A review of research relating to narrative processing by moving image versus language |
| title | Picture this: A review of research relating to narrative processing by moving image versus language |
| title_full | Picture this: A review of research relating to narrative processing by moving image versus language |
| title_fullStr | Picture this: A review of research relating to narrative processing by moving image versus language |
| title_full_unstemmed | Picture this: A review of research relating to narrative processing by moving image versus language |
| title_short | Picture this: A review of research relating to narrative processing by moving image versus language |
| title_sort | picture this a review of research relating to narrative processing by moving image versus language |
| work_keys_str_mv | AT jajdelskae picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT andersonm picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT butlerc picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT fabbn picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT finnigane picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT garwoodi picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT kellys picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT kirkw picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT kukkonenk picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT mullallys picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage AT schwans picturethisareviewofresearchrelatingtonarrativeprocessingbymovingimageversuslanguage |