A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG

The linguistic complexity of words has largely been studied on the behavioral level and in experimental settings. Only little is known about the neural processes underlying it in uninstructed, spontaneous conversations. We built up a multimodal neurolinguistic corpus composed of synchronized audio,...

Full description

Bibliographic Details
Main Authors: Olga Glanz, Marina Hader, Andreas Schulze-Bonhage, Peter Auer, Tonio Ball
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-02-01
Series:Frontiers in Human Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnhum.2021.711886/full
_version_ 1819291603089489920
author Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Marina Hader
Marina Hader
Andreas Schulze-Bonhage
Andreas Schulze-Bonhage
Peter Auer
Peter Auer
Peter Auer
Tonio Ball
Tonio Ball
Tonio Ball
author_facet Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Marina Hader
Marina Hader
Andreas Schulze-Bonhage
Andreas Schulze-Bonhage
Peter Auer
Peter Auer
Peter Auer
Tonio Ball
Tonio Ball
Tonio Ball
author_sort Olga Glanz
collection DOAJ
description The linguistic complexity of words has largely been studied on the behavioral level and in experimental settings. Only little is known about the neural processes underlying it in uninstructed, spontaneous conversations. We built up a multimodal neurolinguistic corpus composed of synchronized audio, video, and electrocorticographic (ECoG) recordings from the fronto-temporo-parietal cortex to address this phenomenon based on uninstructed, spontaneous speech production. We performed extensive linguistic annotations of the language material and calculated word complexity using several numeric parameters. We orthogonalized the parameters with the help of a linear regression model. Then, we correlated the spectral components of neural activity with the individual linguistic parameters and with the residuals of the linear regression model, and compared the results. The proportional relation between the number of consonants and vowels, which was the most informative parameter with regard to the neural representation of word complexity, showed effects in two areas: the frontal one was at the junction of the premotor cortex, the prefrontal cortex, and Brodmann area 44. The postcentral one lay directly above the lateral sulcus and comprised the ventral central sulcus, the parietal operculum and the adjacent inferior parietal cortex. Beyond the physiological findings summarized here, our methods may be useful for those interested in ways of studying neural effects related to natural language production and in surmounting the intrinsic problem of collinearity between multiple features of spontaneously spoken material.
first_indexed 2024-12-24T03:41:15Z
format Article
id doaj.art-81afda868a7046c297e8b4f9bc81d249
institution Directory Open Access Journal
issn 1662-5161
language English
last_indexed 2024-12-24T03:41:15Z
publishDate 2022-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Human Neuroscience
spelling doaj.art-81afda868a7046c297e8b4f9bc81d2492022-12-21T17:16:53ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612022-02-011510.3389/fnhum.2021.711886711886A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoGOlga Glanz0Olga Glanz1Olga Glanz2Olga Glanz3Olga Glanz4Olga Glanz5Marina Hader6Marina Hader7Andreas Schulze-Bonhage8Andreas Schulze-Bonhage9Peter Auer10Peter Auer11Peter Auer12Tonio Ball13Tonio Ball14Tonio Ball15GRK 1624 “Frequency Effects in Language,” University of Freiburg, Freiburg, GermanyDepartment of German Linguistics, University of Freiburg, Freiburg, GermanyThe Hermann Paul School of Linguistics, University of Freiburg, Freiburg, GermanyBrainLinks-BrainTools, University of Freiburg, Freiburg, GermanyNeurobiology and Biophysics, Faculty of Biology, University of Freiburg, Freiburg, GermanyTranslational Neurotechnology Lab, Department of Neurosurgery, Faculty of Medicine, Medical Center—University of Freiburg, University of Freiburg, Freiburg, GermanyBrainLinks-BrainTools, University of Freiburg, Freiburg, GermanyTranslational Neurotechnology Lab, Department of Neurosurgery, Faculty of Medicine, Medical Center—University of Freiburg, University of Freiburg, Freiburg, GermanyDepartment of Neurosurgery, Faculty of Medicine, Epilepsy Center, Medical Center—University of Freiburg, University of Freiburg, Freiburg, GermanyBernstein Center Freiburg, University of Freiburg, Freiburg, GermanyGRK 1624 “Frequency Effects in Language,” University of Freiburg, Freiburg, GermanyDepartment of German Linguistics, University of Freiburg, Freiburg, GermanyThe Hermann Paul School of Linguistics, University of Freiburg, Freiburg, GermanyBrainLinks-BrainTools, University of Freiburg, Freiburg, GermanyTranslational Neurotechnology Lab, Department of Neurosurgery, Faculty of Medicine, Medical Center—University of Freiburg, University of Freiburg, Freiburg, GermanyBernstein Center Freiburg, University of Freiburg, Freiburg, GermanyThe linguistic complexity of words has largely been studied on the behavioral level and in experimental settings. Only little is known about the neural processes underlying it in uninstructed, spontaneous conversations. We built up a multimodal neurolinguistic corpus composed of synchronized audio, video, and electrocorticographic (ECoG) recordings from the fronto-temporo-parietal cortex to address this phenomenon based on uninstructed, spontaneous speech production. We performed extensive linguistic annotations of the language material and calculated word complexity using several numeric parameters. We orthogonalized the parameters with the help of a linear regression model. Then, we correlated the spectral components of neural activity with the individual linguistic parameters and with the residuals of the linear regression model, and compared the results. The proportional relation between the number of consonants and vowels, which was the most informative parameter with regard to the neural representation of word complexity, showed effects in two areas: the frontal one was at the junction of the premotor cortex, the prefrontal cortex, and Brodmann area 44. The postcentral one lay directly above the lateral sulcus and comprised the ventral central sulcus, the parietal operculum and the adjacent inferior parietal cortex. Beyond the physiological findings summarized here, our methods may be useful for those interested in ways of studying neural effects related to natural language production and in surmounting the intrinsic problem of collinearity between multiple features of spontaneously spoken material.https://www.frontiersin.org/articles/10.3389/fnhum.2021.711886/fullnatural behaviorspontaneous speech productionECoGword complexityarticulation
spellingShingle Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Olga Glanz
Marina Hader
Marina Hader
Andreas Schulze-Bonhage
Andreas Schulze-Bonhage
Peter Auer
Peter Auer
Peter Auer
Tonio Ball
Tonio Ball
Tonio Ball
A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG
Frontiers in Human Neuroscience
natural behavior
spontaneous speech production
ECoG
word complexity
articulation
title A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG
title_full A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG
title_fullStr A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG
title_full_unstemmed A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG
title_short A Study of Word Complexity Under Conditions of Non-experimental, Natural Overt Speech Production Using ECoG
title_sort study of word complexity under conditions of non experimental natural overt speech production using ecog
topic natural behavior
spontaneous speech production
ECoG
word complexity
articulation
url https://www.frontiersin.org/articles/10.3389/fnhum.2021.711886/full
work_keys_str_mv AT olgaglanz astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT marinahader astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT marinahader astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT andreasschulzebonhage astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT andreasschulzebonhage astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT peterauer astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT peterauer astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT peterauer astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT tonioball astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT tonioball astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT tonioball astudyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT olgaglanz studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT marinahader studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT marinahader studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT andreasschulzebonhage studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT andreasschulzebonhage studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT peterauer studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT peterauer studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT peterauer studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT tonioball studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT tonioball studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog
AT tonioball studyofwordcomplexityunderconditionsofnonexperimentalnaturalovertspeechproductionusingecog