Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments

Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and mul...

Full description

Bibliographic Details
Main Authors: Scott A. Love, Karin Petrini, Cyril R. Pernet, Marianne Latinus, Frank E. Pollick
Format: Article
Language:English
Published: Frontiers Media S.A. 2018-07-01
Series:Frontiers in Human Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnhum.2018.00274/full
_version_ 1818907469054738432
author Scott A. Love
Scott A. Love
Karin Petrini
Cyril R. Pernet
Marianne Latinus
Marianne Latinus
Frank E. Pollick
author_facet Scott A. Love
Scott A. Love
Karin Petrini
Cyril R. Pernet
Marianne Latinus
Marianne Latinus
Frank E. Pollick
author_sort Scott A. Love
collection DOAJ
description Multisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.
first_indexed 2024-12-19T21:55:37Z
format Article
id doaj.art-5fd27a1b43a5455a85ea1fa577d3e0cb
institution Directory Open Access Journal
issn 1662-5161
language English
last_indexed 2024-12-19T21:55:37Z
publishDate 2018-07-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Human Neuroscience
spelling doaj.art-5fd27a1b43a5455a85ea1fa577d3e0cb2022-12-21T20:04:17ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612018-07-011210.3389/fnhum.2018.00274348530Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order JudgmentsScott A. Love0Scott A. Love1Karin Petrini2Cyril R. Pernet3Marianne Latinus4Marianne Latinus5Frank E. Pollick6School of Psychology, University of Glasgow, Glasgow, United KingdomPhysiologie de la Reproduction et des Comportements, Institut National de la Recherche Agronomique, Centre National de la Recherche Scientifique, IFCE, Université de Tours, Nouzilly, FranceDepartment of Psychology, University of Bath, Bath, United KingdomBrain Research Imaging Centre, Imaging Sciences, University of Edinburgh, Edinburgh, United KingdomSchool of Psychology, University of Glasgow, Glasgow, United KingdomUMR1253, iBrain, Université de Tours, Inserm, Tours, FranceSchool of Psychology, University of Glasgow, Glasgow, United KingdomMultisensory processing is a core perceptual capability, and the need to understand its neural bases provides a fundamental problem in the study of brain function. Both synchrony and temporal order judgments are commonly used to investigate synchrony perception between different sensory cues and multisensory perception in general. However, extensive behavioral evidence indicates that these tasks do not measure identical perceptual processes. Here we used functional magnetic resonance imaging to investigate how behavioral differences between the tasks are instantiated as neural differences. As these neural differences could manifest at either the sustained (task/state-related) and/or transient (event-related) levels of processing, a mixed block/event-related design was used to investigate the neural response of both time-scales. Clear differences in both sustained and transient BOLD responses were observed between the two tasks, consistent with behavioral differences indeed arising from overlapping but divergent neural mechanisms. Temporal order judgments, but not synchrony judgments, required transient activation in several left hemisphere regions, which may reflect increased task demands caused by an extra stage of processing. Our results highlight that multisensory integration mechanisms can be task dependent, which, in particular, has implications for the study of atypical temporal processing in clinical populations.https://www.frontiersin.org/article/10.3389/fnhum.2018.00274/fullmultisensoryaudiovisualfMRItemporal processingasynchrony
spellingShingle Scott A. Love
Scott A. Love
Karin Petrini
Cyril R. Pernet
Marianne Latinus
Marianne Latinus
Frank E. Pollick
Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments
Frontiers in Human Neuroscience
multisensory
audiovisual
fMRI
temporal processing
asynchrony
title Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments
title_full Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments
title_fullStr Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments
title_full_unstemmed Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments
title_short Overlapping but Divergent Neural Correlates Underpinning Audiovisual Synchrony and Temporal Order Judgments
title_sort overlapping but divergent neural correlates underpinning audiovisual synchrony and temporal order judgments
topic multisensory
audiovisual
fMRI
temporal processing
asynchrony
url https://www.frontiersin.org/article/10.3389/fnhum.2018.00274/full
work_keys_str_mv AT scottalove overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments
AT scottalove overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments
AT karinpetrini overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments
AT cyrilrpernet overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments
AT mariannelatinus overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments
AT mariannelatinus overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments
AT frankepollick overlappingbutdivergentneuralcorrelatesunderpinningaudiovisualsynchronyandtemporalorderjudgments