Congruent aero-tactile stimuli bias perception of voicing continua
Multimodal integration is the formation of a coherent percept from different sensory inputs such as vision, audition, and somatosensation. Most research on multimodal integration in speech perception has focused on audio-visual integration. In recent years, audio-tactile integration has also been in...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-07-01
|
| Series: | Frontiers in Human Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnhum.2022.879981/full |
| _version_ | 1811289380281647104 |
|---|---|
| author | Dolly Goldenberg Mark K. Tiede Ryan T. Bennett D. H. Whalen D. H. Whalen D. H. Whalen |
| author_facet | Dolly Goldenberg Mark K. Tiede Ryan T. Bennett D. H. Whalen D. H. Whalen D. H. Whalen |
| author_sort | Dolly Goldenberg |
| collection | DOAJ |
| description | Multimodal integration is the formation of a coherent percept from different sensory inputs such as vision, audition, and somatosensation. Most research on multimodal integration in speech perception has focused on audio-visual integration. In recent years, audio-tactile integration has also been investigated, and it has been established that puffs of air applied to the skin and timed with listening tasks shift the perception of voicing by naive listeners. The current study has replicated and extended these findings by testing the effect of air puffs on gradations of voice onset time along a continuum rather than the voiced and voiceless endpoints of the original work. Three continua were tested: bilabial (“pa/ba”), velar (“ka/ga”), and a vowel continuum (“head/hid”) used as a control. The presence of air puffs was found to significantly increase the likelihood of choosing voiceless responses for the two VOT continua but had no effect on choices for the vowel continuum. Analysis of response times revealed that the presence of air puffs lengthened responses for intermediate (ambiguous) stimuli and shortened them for endpoint (non-ambiguous) stimuli. The slowest response times were observed for the intermediate steps for all three continua, but for the bilabial continuum this effect interacted with the presence of air puffs: responses were slower in the presence of air puffs, and faster in their absence. This suggests that during integration auditory and aero-tactile inputs are weighted differently by the perceptual system, with the latter exerting greater influence in those cases where the auditory cues for voicing are ambiguous. |
| first_indexed | 2024-04-13T03:53:52Z |
| format | Article |
| id | doaj.art-ea813d7e45094406a78c7f9a140bb718 |
| institution | Directory Open Access Journal |
| issn | 1662-5161 |
| language | English |
| last_indexed | 2024-04-13T03:53:52Z |
| publishDate | 2022-07-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Human Neuroscience |
| spelling | doaj.art-ea813d7e45094406a78c7f9a140bb7182022-12-22T03:03:43ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612022-07-011610.3389/fnhum.2022.879981879981Congruent aero-tactile stimuli bias perception of voicing continuaDolly Goldenberg0Mark K. Tiede1Ryan T. Bennett2D. H. Whalen3D. H. Whalen4D. H. Whalen5Haskins Laboratories, New Haven, CT, United StatesHaskins Laboratories, New Haven, CT, United StatesDepartment of Linguistics, University of California, Santa Cruz, Santa Cruz, CA, United StatesHaskins Laboratories, New Haven, CT, United StatesThe Graduate Center, City University of New York (CUNY), New York, NY, United StatesDepartment of Linguistics, Yale University, New Haven, CT, United StatesMultimodal integration is the formation of a coherent percept from different sensory inputs such as vision, audition, and somatosensation. Most research on multimodal integration in speech perception has focused on audio-visual integration. In recent years, audio-tactile integration has also been investigated, and it has been established that puffs of air applied to the skin and timed with listening tasks shift the perception of voicing by naive listeners. The current study has replicated and extended these findings by testing the effect of air puffs on gradations of voice onset time along a continuum rather than the voiced and voiceless endpoints of the original work. Three continua were tested: bilabial (“pa/ba”), velar (“ka/ga”), and a vowel continuum (“head/hid”) used as a control. The presence of air puffs was found to significantly increase the likelihood of choosing voiceless responses for the two VOT continua but had no effect on choices for the vowel continuum. Analysis of response times revealed that the presence of air puffs lengthened responses for intermediate (ambiguous) stimuli and shortened them for endpoint (non-ambiguous) stimuli. The slowest response times were observed for the intermediate steps for all three continua, but for the bilabial continuum this effect interacted with the presence of air puffs: responses were slower in the presence of air puffs, and faster in their absence. This suggests that during integration auditory and aero-tactile inputs are weighted differently by the perceptual system, with the latter exerting greater influence in those cases where the auditory cues for voicing are ambiguous.https://www.frontiersin.org/articles/10.3389/fnhum.2022.879981/fullsensory integrationaction-perceptionmultimodal speech perceptionperceptual unitstactile perception |
| spellingShingle | Dolly Goldenberg Mark K. Tiede Ryan T. Bennett D. H. Whalen D. H. Whalen D. H. Whalen Congruent aero-tactile stimuli bias perception of voicing continua Frontiers in Human Neuroscience sensory integration action-perception multimodal speech perception perceptual units tactile perception |
| title | Congruent aero-tactile stimuli bias perception of voicing continua |
| title_full | Congruent aero-tactile stimuli bias perception of voicing continua |
| title_fullStr | Congruent aero-tactile stimuli bias perception of voicing continua |
| title_full_unstemmed | Congruent aero-tactile stimuli bias perception of voicing continua |
| title_short | Congruent aero-tactile stimuli bias perception of voicing continua |
| title_sort | congruent aero tactile stimuli bias perception of voicing continua |
| topic | sensory integration action-perception multimodal speech perception perceptual units tactile perception |
| url | https://www.frontiersin.org/articles/10.3389/fnhum.2022.879981/full |
| work_keys_str_mv | AT dollygoldenberg congruentaerotactilestimulibiasperceptionofvoicingcontinua AT markktiede congruentaerotactilestimulibiasperceptionofvoicingcontinua AT ryantbennett congruentaerotactilestimulibiasperceptionofvoicingcontinua AT dhwhalen congruentaerotactilestimulibiasperceptionofvoicingcontinua AT dhwhalen congruentaerotactilestimulibiasperceptionofvoicingcontinua AT dhwhalen congruentaerotactilestimulibiasperceptionofvoicingcontinua |