The optimal time window of visual-auditory integration: a reaction time analysis
The spatiotemporal window of integration has become a widely accepted concept in multisensory research: crossmodal information falling within this window is highly likely to be integrated, whereas information falling outside is not. Here we further probe this concept in a reaction time context wi...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2010-05-01
|
| Series: | Frontiers in Integrative Neuroscience |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/Journal/10.3389/fnint.2010.00011/full |
| _version_ | 1819230718952210432 |
|---|---|
| author | Hans Colonius Adele Diederich |
| author_facet | Hans Colonius Adele Diederich |
| author_sort | Hans Colonius |
| collection | DOAJ |
| description | The spatiotemporal window of integration has become a widely accepted concept in multisensory research: crossmodal information falling within this window is highly likely to be integrated, whereas information falling outside is not. Here we further probe this concept in a reaction time context with redundant crossmodal targets. An infinitely large time window would lead to mandatory integration, a zero-width time window would rule out integration entirely. Making explicit assumptions about the arrival time difference between peripheral sensory processing times triggered by a crossmodal stimulus set, we derive a decision rule that determines an optimal window width as a function of (i) the prior odds in favor of a common multisensory source, (ii) the likelihood of arrival time differences, and (iii) the payoff for making correct or wrong decisions; moreover, we suggest a detailed experimental setup to test the theory. Our approach is in line with the well-established framework for modeling multisensory integration as (nearly) optimal decision making, but none of those studies, to our knowledge, has considered reaction time as observable variable. The theory can easily be extended to reaction times collected under the focused attention paradigm. Possible variants of the theory to account for judgments of crossmodal simultaneity are discussed. Finally, neural underpinnings of the theory in terms of oscillatory responses in primary sensory cortices are hypothesized. |
| first_indexed | 2024-12-23T11:33:32Z |
| format | Article |
| id | doaj.art-a6d945b29e1549a5bc9d88f444b04b43 |
| institution | Directory Open Access Journal |
| issn | 1662-5145 |
| language | English |
| last_indexed | 2024-12-23T11:33:32Z |
| publishDate | 2010-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Integrative Neuroscience |
| spelling | doaj.art-a6d945b29e1549a5bc9d88f444b04b432022-12-21T17:48:43ZengFrontiers Media S.A.Frontiers in Integrative Neuroscience1662-51452010-05-01410.3389/fnint.2010.000111316The optimal time window of visual-auditory integration: a reaction time analysisHans Colonius0Adele Diederich1University of OldenburgJacobs University BremenThe spatiotemporal window of integration has become a widely accepted concept in multisensory research: crossmodal information falling within this window is highly likely to be integrated, whereas information falling outside is not. Here we further probe this concept in a reaction time context with redundant crossmodal targets. An infinitely large time window would lead to mandatory integration, a zero-width time window would rule out integration entirely. Making explicit assumptions about the arrival time difference between peripheral sensory processing times triggered by a crossmodal stimulus set, we derive a decision rule that determines an optimal window width as a function of (i) the prior odds in favor of a common multisensory source, (ii) the likelihood of arrival time differences, and (iii) the payoff for making correct or wrong decisions; moreover, we suggest a detailed experimental setup to test the theory. Our approach is in line with the well-established framework for modeling multisensory integration as (nearly) optimal decision making, but none of those studies, to our knowledge, has considered reaction time as observable variable. The theory can easily be extended to reaction times collected under the focused attention paradigm. Possible variants of the theory to account for judgments of crossmodal simultaneity are discussed. Finally, neural underpinnings of the theory in terms of oscillatory responses in primary sensory cortices are hypothesized.http://journal.frontiersin.org/Journal/10.3389/fnint.2010.00011/fullBayesian estimationmultisensory integrationoptimal decision rulesaccadic reaction timetime window of integrationTWIN model |
| spellingShingle | Hans Colonius Adele Diederich The optimal time window of visual-auditory integration: a reaction time analysis Frontiers in Integrative Neuroscience Bayesian estimation multisensory integration optimal decision rule saccadic reaction time time window of integration TWIN model |
| title | The optimal time window of visual-auditory integration: a reaction time analysis |
| title_full | The optimal time window of visual-auditory integration: a reaction time analysis |
| title_fullStr | The optimal time window of visual-auditory integration: a reaction time analysis |
| title_full_unstemmed | The optimal time window of visual-auditory integration: a reaction time analysis |
| title_short | The optimal time window of visual-auditory integration: a reaction time analysis |
| title_sort | optimal time window of visual auditory integration a reaction time analysis |
| topic | Bayesian estimation multisensory integration optimal decision rule saccadic reaction time time window of integration TWIN model |
| url | http://journal.frontiersin.org/Journal/10.3389/fnint.2010.00011/full |
| work_keys_str_mv | AT hanscolonius theoptimaltimewindowofvisualauditoryintegrationareactiontimeanalysis AT adelediederich theoptimaltimewindowofvisualauditoryintegrationareactiontimeanalysis AT hanscolonius optimaltimewindowofvisualauditoryintegrationareactiontimeanalysis AT adelediederich optimaltimewindowofvisualauditoryintegrationareactiontimeanalysis |