Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.

In their recent article, Sweeny, Guzman-Martinez, Ortega, Grabowecky, and Suzuki (2012) demonstrate that heard speech sounds modulate the perceived shape of briefly presented visual stimuli. Ovals, whose aspect ratio (relating width to height) varied on a trial-by-trial basis, were rated as looking...

Full description

Bibliographic Details
Main Authors: Spence, C, Deroy, O
Format: Journal article
Language:English
Published: 2012
_version_ 1797059014328057856
author Spence, C
Deroy, O
author_facet Spence, C
Deroy, O
author_sort Spence, C
collection OXFORD
description In their recent article, Sweeny, Guzman-Martinez, Ortega, Grabowecky, and Suzuki (2012) demonstrate that heard speech sounds modulate the perceived shape of briefly presented visual stimuli. Ovals, whose aspect ratio (relating width to height) varied on a trial-by-trial basis, were rated as looking wider when a /woo/ sound was presented, and as taller when a /wee/ sound was presented instead. On the one hand, these findings add to a growing body of evidence demonstrating that audiovisual correspondences can have perceptual (as well as decisional) effects. On the other hand, they prompt a question concerning their origin. Although the currently popular view is that crossmodal correspondences are based on the internalization of the natural multisensory statistics of the environment (see Spence, 2011), these new results suggest instead that certain correspondences may actually be based on the sensorimotor responses associated with human vocalizations. As such, the findings of Sweeny et al. help to breathe new life into Sapir's (1929) once-popular "embodied" explanation of sound symbolism. Furthermore, they pose a challenge for those psychologists wanting to determine which among a number of plausible accounts best explains the available data on crossmodal correspondences.
first_indexed 2024-03-06T19:58:14Z
format Journal article
id oxford-uuid:2662ccff-3f03-49d2-a432-945bc6de7843
institution University of Oxford
language English
last_indexed 2024-03-06T19:58:14Z
publishDate 2012
record_format dspace
spelling oxford-uuid:2662ccff-3f03-49d2-a432-945bc6de78432022-03-26T12:00:37ZHearing mouth shapes: Sound symbolism and the reverse McGurk effect.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:2662ccff-3f03-49d2-a432-945bc6de7843EnglishSymplectic Elements at Oxford2012Spence, CDeroy, OIn their recent article, Sweeny, Guzman-Martinez, Ortega, Grabowecky, and Suzuki (2012) demonstrate that heard speech sounds modulate the perceived shape of briefly presented visual stimuli. Ovals, whose aspect ratio (relating width to height) varied on a trial-by-trial basis, were rated as looking wider when a /woo/ sound was presented, and as taller when a /wee/ sound was presented instead. On the one hand, these findings add to a growing body of evidence demonstrating that audiovisual correspondences can have perceptual (as well as decisional) effects. On the other hand, they prompt a question concerning their origin. Although the currently popular view is that crossmodal correspondences are based on the internalization of the natural multisensory statistics of the environment (see Spence, 2011), these new results suggest instead that certain correspondences may actually be based on the sensorimotor responses associated with human vocalizations. As such, the findings of Sweeny et al. help to breathe new life into Sapir's (1929) once-popular "embodied" explanation of sound symbolism. Furthermore, they pose a challenge for those psychologists wanting to determine which among a number of plausible accounts best explains the available data on crossmodal correspondences.
spellingShingle Spence, C
Deroy, O
Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
title Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
title_full Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
title_fullStr Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
title_full_unstemmed Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
title_short Hearing mouth shapes: Sound symbolism and the reverse McGurk effect.
title_sort hearing mouth shapes sound symbolism and the reverse mcgurk effect
work_keys_str_mv AT spencec hearingmouthshapessoundsymbolismandthereversemcgurkeffect
AT deroyo hearingmouthshapessoundsymbolismandthereversemcgurkeffect