Perceived synchrony for realistic and dynamic audiovisual events
In well-controlled laboratory experiments, researchers have found that humans can perceive delays between auditory and visual signals as short as 20 ms. Conversely, other experiments have shown that humans can tolerate audiovisual asynchrony that exceeds 200 ms. This seeming contradiction in human t...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2015-06-01
|
| Series: | Frontiers in Psychology |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.00736/full |
| _version_ | 1818970660840407040 |
|---|---|
| author | Ragnhild eEg Dawn Marie Behne |
| author_facet | Ragnhild eEg Dawn Marie Behne |
| author_sort | Ragnhild eEg |
| collection | DOAJ |
| description | In well-controlled laboratory experiments, researchers have found that humans can perceive delays between auditory and visual signals as short as 20 ms. Conversely, other experiments have shown that humans can tolerate audiovisual asynchrony that exceeds 200 ms. This seeming contradiction in human temporal sensitivity can be attributed to a number of factors such as experimental approaches and precedence of the asynchronous signals, along with the nature, duration, location, complexity and repetitiveness of the audiovisual stimuli, and even individual differences. In order to better understand how temporal integration of audiovisual events occurs in the real world, we need to close the gap between the experimental setting and the complex setting of everyday life. With this work, we aimed to contribute one brick to the bridge that will close this gap. We compared perceived synchrony for long-running and eventful audiovisual sequences to shorter sequences that contain a single audiovisual event, for three types of content: action, music, and speech. The resulting windows of temporal integration showed that participants were better at detecting asynchrony for the longer stimuli, possibly because the long-running sequences contain multiple corresponding events that offer audiovisual timing cues. Moreover, the points of subjective simultaneity differ between content types, suggesting that the nature of a visual scene could influence the temporal perception of events. An expected outcome from this type of experiment was the rich variation among participants' distributions and the derived points of subjective simultaneity. Hence, the designs of similar experiments call for more participants than traditional psychophysical studies. Heeding this caution, we conclude that existing theories on multisensory perception are ready to be tested on more natural and representative stimuli. |
| first_indexed | 2024-12-20T14:40:01Z |
| format | Article |
| id | doaj.art-ca5be7086b9d43678581ac2d247ebd5e |
| institution | Directory Open Access Journal |
| issn | 1664-1078 |
| language | English |
| last_indexed | 2024-12-20T14:40:01Z |
| publishDate | 2015-06-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychology |
| spelling | doaj.art-ca5be7086b9d43678581ac2d247ebd5e2022-12-21T19:37:21ZengFrontiers Media S.A.Frontiers in Psychology1664-10782015-06-01610.3389/fpsyg.2015.00736136772Perceived synchrony for realistic and dynamic audiovisual eventsRagnhild eEg0Dawn Marie Behne1Simula Research LaboratoryNorwegian University of Science and TechnologyIn well-controlled laboratory experiments, researchers have found that humans can perceive delays between auditory and visual signals as short as 20 ms. Conversely, other experiments have shown that humans can tolerate audiovisual asynchrony that exceeds 200 ms. This seeming contradiction in human temporal sensitivity can be attributed to a number of factors such as experimental approaches and precedence of the asynchronous signals, along with the nature, duration, location, complexity and repetitiveness of the audiovisual stimuli, and even individual differences. In order to better understand how temporal integration of audiovisual events occurs in the real world, we need to close the gap between the experimental setting and the complex setting of everyday life. With this work, we aimed to contribute one brick to the bridge that will close this gap. We compared perceived synchrony for long-running and eventful audiovisual sequences to shorter sequences that contain a single audiovisual event, for three types of content: action, music, and speech. The resulting windows of temporal integration showed that participants were better at detecting asynchrony for the longer stimuli, possibly because the long-running sequences contain multiple corresponding events that offer audiovisual timing cues. Moreover, the points of subjective simultaneity differ between content types, suggesting that the nature of a visual scene could influence the temporal perception of events. An expected outcome from this type of experiment was the rich variation among participants' distributions and the derived points of subjective simultaneity. Hence, the designs of similar experiments call for more participants than traditional psychophysical studies. Heeding this caution, we conclude that existing theories on multisensory perception are ready to be tested on more natural and representative stimuli.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.00736/fullTemporal Integrationmultisensory perceptionaudiovisual synchronyVisual distortionComplex stimuli |
| spellingShingle | Ragnhild eEg Dawn Marie Behne Perceived synchrony for realistic and dynamic audiovisual events Frontiers in Psychology Temporal Integration multisensory perception audiovisual synchrony Visual distortion Complex stimuli |
| title | Perceived synchrony for realistic and dynamic audiovisual events |
| title_full | Perceived synchrony for realistic and dynamic audiovisual events |
| title_fullStr | Perceived synchrony for realistic and dynamic audiovisual events |
| title_full_unstemmed | Perceived synchrony for realistic and dynamic audiovisual events |
| title_short | Perceived synchrony for realistic and dynamic audiovisual events |
| title_sort | perceived synchrony for realistic and dynamic audiovisual events |
| topic | Temporal Integration multisensory perception audiovisual synchrony Visual distortion Complex stimuli |
| url | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2015.00736/full |
| work_keys_str_mv | AT ragnhildeeg perceivedsynchronyforrealisticanddynamicaudiovisualevents AT dawnmariebehne perceivedsynchronyforrealisticanddynamicaudiovisualevents |