An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception
Research has shown that visual speech perception can assist accuracy in identification of spoken words. However, little is known about the dynamics of the processing mechanisms involved in audiovisual integration. In particular, architecture and capacity, measured using response time methodologies,...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2011-09-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2011.00238/full |
| _version_ | 1818348944828137472 |
|---|---|
| author | Nicholas eAltieri James T Townsend |
| author_facet | Nicholas eAltieri James T Townsend |
| author_sort | Nicholas eAltieri |
| collection | DOAJ |
| description | Research has shown that visual speech perception can assist accuracy in identification of spoken words. However, little is known about the dynamics of the processing mechanisms involved in audiovisual integration. In particular, architecture and capacity, measured using response time methodologies, have not been investigated. An issue related to architecture concerns whether the auditory and visual sources of the speech signal are integrated early or late. We propose that early integration most naturally corresponds to coactive processing whereas late integration corresponds to separate decisions parallel processing. We implemented the Double Factorial Paradigm (DFP) in two studies. First, we carried out a pilot study using a two alternative forced-choice discrimination task to assess architecture, decision rule, and provide a preliminary assessment of capacity (integration efficiency). Next, Experiment 1 was designed to specifically assess audiovisual integration efficiency in an ecologically valid way by including lower auditory S/N ratios and a larger response set size. Results from the pilot study support a separate decisions parallel, late integration model. Results from both studies showed that capacity was severely limited for high auditory S/N ratios. However, Experiment 1 demonstrated that capacity improved as the auditory signal became more degraded. This evidence strongly suggests that integration efficiency is vitally affected by the S/N ratio. |
| first_indexed | 2024-12-13T17:58:06Z |
| format | Article |
| id | doaj.art-deae1c9d4656415d8e3c0f6326c0019b |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-13T17:58:06Z |
| publishDate | 2011-09-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-deae1c9d4656415d8e3c0f6326c0019b2022-12-21T23:36:20ZengFrontiers Media S.A.Frontiers in Psychology1664-10782011-09-01210.3389/fpsyg.2011.002389844An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech PerceptionNicholas eAltieri0James T Townsend1The University of OklahomaIndiana UniversityResearch has shown that visual speech perception can assist accuracy in identification of spoken words. However, little is known about the dynamics of the processing mechanisms involved in audiovisual integration. In particular, architecture and capacity, measured using response time methodologies, have not been investigated. An issue related to architecture concerns whether the auditory and visual sources of the speech signal are integrated early or late. We propose that early integration most naturally corresponds to coactive processing whereas late integration corresponds to separate decisions parallel processing. We implemented the Double Factorial Paradigm (DFP) in two studies. First, we carried out a pilot study using a two alternative forced-choice discrimination task to assess architecture, decision rule, and provide a preliminary assessment of capacity (integration efficiency). Next, Experiment 1 was designed to specifically assess audiovisual integration efficiency in an ecologically valid way by including lower auditory S/N ratios and a larger response set size. Results from the pilot study support a separate decisions parallel, late integration model. Results from both studies showed that capacity was severely limited for high auditory S/N ratios. However, Experiment 1 demonstrated that capacity improved as the auditory signal became more degraded. This evidence strongly suggests that integration efficiency is vitally affected by the S/N ratio.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2011.00238/fullSpeechCapacitymultisensory integrationCoactiveIntegration EfficiencyParallel |
| spellingShingle | Nicholas eAltieri James T Townsend An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception Frontiers in Psychology Speech Capacity multisensory integration Coactive Integration Efficiency Parallel |
| title | An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception |
| title_full | An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception |
| title_fullStr | An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception |
| title_full_unstemmed | An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception |
| title_short | An Assessment of Behavioral Dynamic Information Processing Measures in Audiovisual Speech Perception |
| title_sort | assessment of behavioral dynamic information processing measures in audiovisual speech perception |
| topic | Speech Capacity multisensory integration Coactive Integration Efficiency Parallel |
| url | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2011.00238/full |
| work_keys_str_mv | AT nicholasealtieri anassessmentofbehavioraldynamicinformationprocessingmeasuresinaudiovisualspeechperception AT jamesttownsend anassessmentofbehavioraldynamicinformationprocessingmeasuresinaudiovisualspeechperception AT nicholasealtieri assessmentofbehavioraldynamicinformationprocessingmeasuresinaudiovisualspeechperception AT jamesttownsend assessmentofbehavioraldynamicinformationprocessingmeasuresinaudiovisualspeechperception |