The effects of attention on the temporal integration of multisensory stimuli

In unisensory contexts, spatially-focused attention tends to enhance perceptual processing. How attention influences the processing of multisensory stimuli, however, has been of much debate. In some cases, attention has been shown to be important for processes related to the integration of audio-vis...

Full description

Bibliographic Details
Main Authors: Sarah E. Donohue, Jessica J. Green, Marty G Woldorff
Format: Article
Language:English
Published: Frontiers Media S.A. 2015-04-01
Series:Frontiers in Integrative Neuroscience
Subjects:
Online Access:http://journal.frontiersin.org/Journal/10.3389/fnint.2015.00032/full
_version_ 1818324796846374912
author Sarah E. Donohue
Sarah E. Donohue
Sarah E. Donohue
Jessica J. Green
Jessica J. Green
Marty G Woldorff
Marty G Woldorff
Marty G Woldorff
Marty G Woldorff
author_facet Sarah E. Donohue
Sarah E. Donohue
Sarah E. Donohue
Jessica J. Green
Jessica J. Green
Marty G Woldorff
Marty G Woldorff
Marty G Woldorff
Marty G Woldorff
author_sort Sarah E. Donohue
collection DOAJ
description In unisensory contexts, spatially-focused attention tends to enhance perceptual processing. How attention influences the processing of multisensory stimuli, however, has been of much debate. In some cases, attention has been shown to be important for processes related to the integration of audio-visual stimuli, but in other cases such processes have been reported to occur independently of attention. To address these conflicting results, we performed three experiments to examine how attention interacts with a key facet of multisensory processing: the temporal window of integration (TWI). The first two experiments used a novel cued-spatial-attention version of the bounce/stream illusion, where two moving visual stimuli with intersecting paths tend to be perceived as bouncing off rather than streaming through each other when a brief sound occurs near in time. When the task was to report whether the visual stimuli appeared to bounce or stream, attention served to narrow this measure of the TWI and bias perception toward ‘streaming’. When the participants’ task was to explicitly judge the simultaneity of the sound with the intersection of the moving visual stimuli, however, the results were quite different. Specifically, attention served to mainly widen the TWI, increasing the likelihood of simultaneity perception, while also substantially increasing the simultaneity judgement accuracy when the stimuli were actually physically simultaneous. Finally, in Experiment 3, where the task was to judge the simultaneity of a simple, temporally discrete, flashed, visual stimulus and the same brief tone pip, attention had no effect on the measured TWI. These results highlight the flexibility of attention in enhancing multisensory perception and show that the effect of attention on multisensory processing is highly dependent on the task demands and observer goals.
first_indexed 2024-12-13T11:34:17Z
format Article
id doaj.art-f80adcdc818c4054b12c570398141d96
institution Directory Open Access Journal
issn 1662-5145
language English
last_indexed 2024-12-13T11:34:17Z
publishDate 2015-04-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Integrative Neuroscience
spelling doaj.art-f80adcdc818c4054b12c570398141d962022-12-21T23:47:50ZengFrontiers Media S.A.Frontiers in Integrative Neuroscience1662-51452015-04-01910.3389/fnint.2015.00032117256The effects of attention on the temporal integration of multisensory stimuliSarah E. Donohue0Sarah E. Donohue1Sarah E. Donohue2Jessica J. Green3Jessica J. Green4Marty G Woldorff5Marty G Woldorff6Marty G Woldorff7Marty G Woldorff8Duke UniversityOtto von Guericke University, MagdeburgLeibniz Institute for NeurobiologyDuke UniversityUniversity of South CarolinaDuke UniversityOtto von Guericke University, MagdeburgLeibniz Institute for NeurobiologyDuke UniversityIn unisensory contexts, spatially-focused attention tends to enhance perceptual processing. How attention influences the processing of multisensory stimuli, however, has been of much debate. In some cases, attention has been shown to be important for processes related to the integration of audio-visual stimuli, but in other cases such processes have been reported to occur independently of attention. To address these conflicting results, we performed three experiments to examine how attention interacts with a key facet of multisensory processing: the temporal window of integration (TWI). The first two experiments used a novel cued-spatial-attention version of the bounce/stream illusion, where two moving visual stimuli with intersecting paths tend to be perceived as bouncing off rather than streaming through each other when a brief sound occurs near in time. When the task was to report whether the visual stimuli appeared to bounce or stream, attention served to narrow this measure of the TWI and bias perception toward ‘streaming’. When the participants’ task was to explicitly judge the simultaneity of the sound with the intersection of the moving visual stimuli, however, the results were quite different. Specifically, attention served to mainly widen the TWI, increasing the likelihood of simultaneity perception, while also substantially increasing the simultaneity judgement accuracy when the stimuli were actually physically simultaneous. Finally, in Experiment 3, where the task was to judge the simultaneity of a simple, temporally discrete, flashed, visual stimulus and the same brief tone pip, attention had no effect on the measured TWI. These results highlight the flexibility of attention in enhancing multisensory perception and show that the effect of attention on multisensory processing is highly dependent on the task demands and observer goals.http://journal.frontiersin.org/Journal/10.3389/fnint.2015.00032/fullAttentionaudiovisualCueingmultisensoryTemporalbounce-stream
spellingShingle Sarah E. Donohue
Sarah E. Donohue
Sarah E. Donohue
Jessica J. Green
Jessica J. Green
Marty G Woldorff
Marty G Woldorff
Marty G Woldorff
Marty G Woldorff
The effects of attention on the temporal integration of multisensory stimuli
Frontiers in Integrative Neuroscience
Attention
audiovisual
Cueing
multisensory
Temporal
bounce-stream
title The effects of attention on the temporal integration of multisensory stimuli
title_full The effects of attention on the temporal integration of multisensory stimuli
title_fullStr The effects of attention on the temporal integration of multisensory stimuli
title_full_unstemmed The effects of attention on the temporal integration of multisensory stimuli
title_short The effects of attention on the temporal integration of multisensory stimuli
title_sort effects of attention on the temporal integration of multisensory stimuli
topic Attention
audiovisual
Cueing
multisensory
Temporal
bounce-stream
url http://journal.frontiersin.org/Journal/10.3389/fnint.2015.00032/full
work_keys_str_mv AT sarahedonohue theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT sarahedonohue theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT sarahedonohue theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT jessicajgreen theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT jessicajgreen theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff theeffectsofattentiononthetemporalintegrationofmultisensorystimuli
AT sarahedonohue effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT sarahedonohue effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT sarahedonohue effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT jessicajgreen effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT jessicajgreen effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff effectsofattentiononthetemporalintegrationofmultisensorystimuli
AT martygwoldorff effectsofattentiononthetemporalintegrationofmultisensorystimuli