Rapid recalibration of speech perception after experiencing the McGurk illusion

The human brain can quickly adapt to changes in the environment. One example is phonetic recalibration: a speech sound is interpreted differently depending on the visual speech and this interpretation persists in the absence of visual information. Here, we examined the mechanisms of phonetic recalib...

Full description

Bibliographic Details
Main Authors: Claudia S. Lüttke, Alexis Pérez-Bellido, Floris P. de Lange
Format: Article
Language:English
Published: The Royal Society 2018-01-01
Series:Royal Society Open Science
Subjects:
Online Access:https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.170909
_version_ 1818161064371552256
author Claudia S. Lüttke
Alexis Pérez-Bellido
Floris P. de Lange
author_facet Claudia S. Lüttke
Alexis Pérez-Bellido
Floris P. de Lange
author_sort Claudia S. Lüttke
collection DOAJ
description The human brain can quickly adapt to changes in the environment. One example is phonetic recalibration: a speech sound is interpreted differently depending on the visual speech and this interpretation persists in the absence of visual information. Here, we examined the mechanisms of phonetic recalibration. Participants categorized the auditory syllables /aba/ and /ada/, which were sometimes preceded by the so-called McGurk stimuli (in which an /aba/ sound, due to visual /aga/ input, is often perceived as ‘ada’). We found that only one trial of exposure to the McGurk illusion was sufficient to induce a recalibration effect, i.e. an auditory /aba/ stimulus was subsequently more often perceived as ‘ada’. Furthermore, phonetic recalibration took place only when auditory and visual inputs were integrated to ‘ada’ (McGurk illusion). Moreover, this recalibration depended on the sensory similarity between the preceding and current auditory stimulus. Finally, signal detection theoretical analysis showed that McGurk-induced phonetic recalibration resulted in both a criterion shift towards /ada/ and a reduced sensitivity to distinguish between /aba/ and /ada/ sounds. The current study shows that phonetic recalibration is dependent on the perceptual integration of audiovisual information and leads to a perceptual shift in phoneme categorization.
first_indexed 2024-12-11T16:11:50Z
format Article
id doaj.art-95fa6548f151448bbf4f2c551283ab88
institution Directory Open Access Journal
issn 2054-5703
language English
last_indexed 2024-12-11T16:11:50Z
publishDate 2018-01-01
publisher The Royal Society
record_format Article
series Royal Society Open Science
spelling doaj.art-95fa6548f151448bbf4f2c551283ab882022-12-22T00:59:03ZengThe Royal SocietyRoyal Society Open Science2054-57032018-01-015310.1098/rsos.170909170909Rapid recalibration of speech perception after experiencing the McGurk illusionClaudia S. LüttkeAlexis Pérez-BellidoFloris P. de LangeThe human brain can quickly adapt to changes in the environment. One example is phonetic recalibration: a speech sound is interpreted differently depending on the visual speech and this interpretation persists in the absence of visual information. Here, we examined the mechanisms of phonetic recalibration. Participants categorized the auditory syllables /aba/ and /ada/, which were sometimes preceded by the so-called McGurk stimuli (in which an /aba/ sound, due to visual /aga/ input, is often perceived as ‘ada’). We found that only one trial of exposure to the McGurk illusion was sufficient to induce a recalibration effect, i.e. an auditory /aba/ stimulus was subsequently more often perceived as ‘ada’. Furthermore, phonetic recalibration took place only when auditory and visual inputs were integrated to ‘ada’ (McGurk illusion). Moreover, this recalibration depended on the sensory similarity between the preceding and current auditory stimulus. Finally, signal detection theoretical analysis showed that McGurk-induced phonetic recalibration resulted in both a criterion shift towards /ada/ and a reduced sensitivity to distinguish between /aba/ and /ada/ sounds. The current study shows that phonetic recalibration is dependent on the perceptual integration of audiovisual information and leads to a perceptual shift in phoneme categorization.https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.170909perceptual learningmcgurk illusionaudiovisual integrationrecalibrationsignal detection theory
spellingShingle Claudia S. Lüttke
Alexis Pérez-Bellido
Floris P. de Lange
Rapid recalibration of speech perception after experiencing the McGurk illusion
Royal Society Open Science
perceptual learning
mcgurk illusion
audiovisual integration
recalibration
signal detection theory
title Rapid recalibration of speech perception after experiencing the McGurk illusion
title_full Rapid recalibration of speech perception after experiencing the McGurk illusion
title_fullStr Rapid recalibration of speech perception after experiencing the McGurk illusion
title_full_unstemmed Rapid recalibration of speech perception after experiencing the McGurk illusion
title_short Rapid recalibration of speech perception after experiencing the McGurk illusion
title_sort rapid recalibration of speech perception after experiencing the mcgurk illusion
topic perceptual learning
mcgurk illusion
audiovisual integration
recalibration
signal detection theory
url https://royalsocietypublishing.org/doi/pdf/10.1098/rsos.170909
work_keys_str_mv AT claudiasluttke rapidrecalibrationofspeechperceptionafterexperiencingthemcgurkillusion
AT alexisperezbellido rapidrecalibrationofspeechperceptionafterexperiencingthemcgurkillusion
AT florispdelange rapidrecalibrationofspeechperceptionafterexperiencingthemcgurkillusion