Crossmodal processing of environmental sounds and everyday life actions: An ERP study

To investigate the processing of environmental sounds, previous researchers have compared the semantic processing of words and sounds, yielding mixed results. This study aimed to specifically investigate the electrophysiological mechanism underlying the semantic processing of environmental sounds pr...

Full description

Bibliographic Details
Main Authors: Mirella Manfredi, Pamella Sanchez Mello de Pinho, Lucas Murrins Marques, Beatriz de Oliveira Ribeiro, Paulo Sergio Boggio
Format: Article
Language:English
Published: Elsevier 2021-09-01
Series:Heliyon
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2405844021020405
_version_ 1828914574203551744
author Mirella Manfredi
Pamella Sanchez Mello de Pinho
Lucas Murrins Marques
Beatriz de Oliveira Ribeiro
Paulo Sergio Boggio
author_facet Mirella Manfredi
Pamella Sanchez Mello de Pinho
Lucas Murrins Marques
Beatriz de Oliveira Ribeiro
Paulo Sergio Boggio
author_sort Mirella Manfredi
collection DOAJ
description To investigate the processing of environmental sounds, previous researchers have compared the semantic processing of words and sounds, yielding mixed results. This study aimed to specifically investigate the electrophysiological mechanism underlying the semantic processing of environmental sounds presented in a naturalistic visual scene. We recorded event-related brain potentials in a group of young adults over the presentation of everyday life actions that were either congruent or incongruent with environmental sounds. Our results showed that incongruent environmental sounds evoked both a P400 and an N400 effect, reflecting sensitivity to physical and semantic violations of environmental sounds’ properties, respectively. In addition, our findings showed an enhanced late positivity in response to incongruous environmental sounds, probably reflecting additional reanalysis costs. In conclusion, these results indicate that the crossmodal processing of the environmental sounds might require the simultaneous involvement of different cognitive processes.
first_indexed 2024-12-13T19:58:14Z
format Article
id doaj.art-4938db4d1fc440fe9e9dfb03857d2b1a
institution Directory Open Access Journal
issn 2405-8440
language English
last_indexed 2024-12-13T19:58:14Z
publishDate 2021-09-01
publisher Elsevier
record_format Article
series Heliyon
spelling doaj.art-4938db4d1fc440fe9e9dfb03857d2b1a2022-12-21T23:33:15ZengElsevierHeliyon2405-84402021-09-0179e07937Crossmodal processing of environmental sounds and everyday life actions: An ERP studyMirella Manfredi0Pamella Sanchez Mello de Pinho1Lucas Murrins Marques2Beatriz de Oliveira Ribeiro3Paulo Sergio Boggio4Department of Psychology, University of Zurich, Zurich, Switzerland; Corresponding author.Social and Cognitive Neuroscience Laboratory, Developmental Disorders Program, Center for Health and Biological Sciences, Mackenzie Presbyterian University, Sao Paulo, BrazilSocial and Cognitive Neuroscience Laboratory, Developmental Disorders Program, Center for Health and Biological Sciences, Mackenzie Presbyterian University, Sao Paulo, BrazilSocial and Cognitive Neuroscience Laboratory, Developmental Disorders Program, Center for Health and Biological Sciences, Mackenzie Presbyterian University, Sao Paulo, BrazilSocial and Cognitive Neuroscience Laboratory, Developmental Disorders Program, Center for Health and Biological Sciences, Mackenzie Presbyterian University, Sao Paulo, Brazil; Corresponding author.To investigate the processing of environmental sounds, previous researchers have compared the semantic processing of words and sounds, yielding mixed results. This study aimed to specifically investigate the electrophysiological mechanism underlying the semantic processing of environmental sounds presented in a naturalistic visual scene. We recorded event-related brain potentials in a group of young adults over the presentation of everyday life actions that were either congruent or incongruent with environmental sounds. Our results showed that incongruent environmental sounds evoked both a P400 and an N400 effect, reflecting sensitivity to physical and semantic violations of environmental sounds’ properties, respectively. In addition, our findings showed an enhanced late positivity in response to incongruous environmental sounds, probably reflecting additional reanalysis costs. In conclusion, these results indicate that the crossmodal processing of the environmental sounds might require the simultaneous involvement of different cognitive processes.http://www.sciencedirect.com/science/article/pii/S2405844021020405Event-related potentialsN400LPHuman actionsCrossmodal processing
spellingShingle Mirella Manfredi
Pamella Sanchez Mello de Pinho
Lucas Murrins Marques
Beatriz de Oliveira Ribeiro
Paulo Sergio Boggio
Crossmodal processing of environmental sounds and everyday life actions: An ERP study
Heliyon
Event-related potentials
N400
LP
Human actions
Crossmodal processing
title Crossmodal processing of environmental sounds and everyday life actions: An ERP study
title_full Crossmodal processing of environmental sounds and everyday life actions: An ERP study
title_fullStr Crossmodal processing of environmental sounds and everyday life actions: An ERP study
title_full_unstemmed Crossmodal processing of environmental sounds and everyday life actions: An ERP study
title_short Crossmodal processing of environmental sounds and everyday life actions: An ERP study
title_sort crossmodal processing of environmental sounds and everyday life actions an erp study
topic Event-related potentials
N400
LP
Human actions
Crossmodal processing
url http://www.sciencedirect.com/science/article/pii/S2405844021020405
work_keys_str_mv AT mirellamanfredi crossmodalprocessingofenvironmentalsoundsandeverydaylifeactionsanerpstudy
AT pamellasanchezmellodepinho crossmodalprocessingofenvironmentalsoundsandeverydaylifeactionsanerpstudy
AT lucasmurrinsmarques crossmodalprocessingofenvironmentalsoundsandeverydaylifeactionsanerpstudy
AT beatrizdeoliveiraribeiro crossmodalprocessingofenvironmentalsoundsandeverydaylifeactionsanerpstudy
AT paulosergioboggio crossmodalprocessingofenvironmentalsoundsandeverydaylifeactionsanerpstudy