Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions
Even though human experience unfolds continuously in time, it is not strictly linear; instead, it entails cascading processes building hierarchical cognitive structures. For instance, during speech perception, humans transform a continuously varying acoustic signal into phonemes, words, and meaning,...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
eLife Sciences Publications Ltd
2023-11-01
|
| Series: | eLife |
| Subjects: | |
| Online Access: | https://elifesciences.org/articles/85012 |
| _version_ | 1797357344147898368 |
|---|---|
| author | Christian Brodbeck Proloy Das Marlies Gillis Joshua P Kulasingham Shohini Bhattasali Phoebe Gaston Philip Resnik Jonathan Z Simon |
| author_facet | Christian Brodbeck Proloy Das Marlies Gillis Joshua P Kulasingham Shohini Bhattasali Phoebe Gaston Philip Resnik Jonathan Z Simon |
| author_sort | Christian Brodbeck |
| collection | DOAJ |
| description | Even though human experience unfolds continuously in time, it is not strictly linear; instead, it entails cascading processes building hierarchical cognitive structures. For instance, during speech perception, humans transform a continuously varying acoustic signal into phonemes, words, and meaning, and these levels all have distinct but interdependent temporal structures. Time-lagged regression using temporal response functions (TRFs) has recently emerged as a promising tool for disentangling electrophysiological brain responses related to such complex models of perception. Here, we introduce the Eelbrain Python toolkit, which makes this kind of analysis easy and accessible. We demonstrate its use, using continuous speech as a sample paradigm, with a freely available EEG dataset of audiobook listening. A companion GitHub repository provides the complete source code for the analysis, from raw data to group-level statistics. More generally, we advocate a hypothesis-driven approach in which the experimenter specifies a hierarchy of time-continuous representations that are hypothesized to have contributed to brain responses, and uses those as predictor variables for the electrophysiological signal. This is analogous to a multiple regression problem, but with the addition of a time dimension. TRF analysis decomposes the brain signal into distinct responses associated with the different predictor variables by estimating a multivariate TRF (mTRF), quantifying the influence of each predictor on brain responses as a function of time(-lags). This allows asking two questions about the predictor variables: (1) Is there a significant neural representation corresponding to this predictor variable? And if so, (2) what are the temporal characteristics of the neural response associated with it? Thus, different predictor variables can be systematically combined and evaluated to jointly model neural processing at multiple hierarchical levels. We discuss applications of this approach, including the potential for linking algorithmic/representational theories at different cognitive levels to brain responses through computational models with appropriate linking hypotheses. |
| first_indexed | 2024-03-08T14:42:32Z |
| format | Article |
| id | doaj.art-2c4e01093efb4056a08028c941b7fdc0 |
| institution | Directory Open Access Journal |
| issn | 2050-084X |
| language | English |
| last_indexed | 2024-03-08T14:42:32Z |
| publishDate | 2023-11-01 |
| publisher | eLife Sciences Publications Ltd |
| record_format | Article |
| series | eLife |
| spelling | doaj.art-2c4e01093efb4056a08028c941b7fdc02024-01-11T15:52:38ZengeLife Sciences Publications LtdeLife2050-084X2023-11-011210.7554/eLife.85012Eelbrain, a Python toolkit for time-continuous analysis with temporal response functionsChristian Brodbeck0https://orcid.org/0000-0001-8380-639XProloy Das1https://orcid.org/0000-0002-8807-042XMarlies Gillis2https://orcid.org/0000-0002-3967-2950Joshua P Kulasingham3Shohini Bhattasali4https://orcid.org/0000-0002-6767-6529Phoebe Gaston5Philip Resnik6Jonathan Z Simon7https://orcid.org/0000-0003-0858-0698McMaster University, Hamilton, CanadaStanford University, Stanford, United StatesKatholieke Universiteit Leuven, Leuven, BelgiumLinköping University, Linköping, SwedenUniversity of Toronto, Toronto, CanadaMcMaster University, Hamilton, CanadaUniversity of Maryland, College Park, College Park, United StatesUniversity of Maryland, College Park, College Park, United StatesEven though human experience unfolds continuously in time, it is not strictly linear; instead, it entails cascading processes building hierarchical cognitive structures. For instance, during speech perception, humans transform a continuously varying acoustic signal into phonemes, words, and meaning, and these levels all have distinct but interdependent temporal structures. Time-lagged regression using temporal response functions (TRFs) has recently emerged as a promising tool for disentangling electrophysiological brain responses related to such complex models of perception. Here, we introduce the Eelbrain Python toolkit, which makes this kind of analysis easy and accessible. We demonstrate its use, using continuous speech as a sample paradigm, with a freely available EEG dataset of audiobook listening. A companion GitHub repository provides the complete source code for the analysis, from raw data to group-level statistics. More generally, we advocate a hypothesis-driven approach in which the experimenter specifies a hierarchy of time-continuous representations that are hypothesized to have contributed to brain responses, and uses those as predictor variables for the electrophysiological signal. This is analogous to a multiple regression problem, but with the addition of a time dimension. TRF analysis decomposes the brain signal into distinct responses associated with the different predictor variables by estimating a multivariate TRF (mTRF), quantifying the influence of each predictor on brain responses as a function of time(-lags). This allows asking two questions about the predictor variables: (1) Is there a significant neural representation corresponding to this predictor variable? And if so, (2) what are the temporal characteristics of the neural response associated with it? Thus, different predictor variables can be systematically combined and evaluated to jointly model neural processing at multiple hierarchical levels. We discuss applications of this approach, including the potential for linking algorithmic/representational theories at different cognitive levels to brain responses through computational models with appropriate linking hypotheses.https://elifesciences.org/articles/85012reverse correlationSTRFopen-source |
| spellingShingle | Christian Brodbeck Proloy Das Marlies Gillis Joshua P Kulasingham Shohini Bhattasali Phoebe Gaston Philip Resnik Jonathan Z Simon Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions eLife reverse correlation STRF open-source |
| title | Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions |
| title_full | Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions |
| title_fullStr | Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions |
| title_full_unstemmed | Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions |
| title_short | Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions |
| title_sort | eelbrain a python toolkit for time continuous analysis with temporal response functions |
| topic | reverse correlation STRF open-source |
| url | https://elifesciences.org/articles/85012 |
| work_keys_str_mv | AT christianbrodbeck eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT proloydas eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT marliesgillis eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT joshuapkulasingham eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT shohinibhattasali eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT phoebegaston eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT philipresnik eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions AT jonathanzsimon eelbrainapythontoolkitfortimecontinuousanalysiswithtemporalresponsefunctions |