Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users
There is a weak relationship between clinical and self-reported speech perception outcomes in cochlear implant (CI) listeners. Such poor correspondence may be due to differences in clinical and “real-world” listening environments and stimuli. Speech in the real world is often accompanied by visual c...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-11-01
|
| Series: | Frontiers in Human Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fnhum.2022.1043499/full |
| _version_ | 1811223276472500224 |
|---|---|
| author | Bowen Xiu Brandon T. Paul Joseph M. Chen Joseph M. Chen Trung N. Le Trung N. Le Vincent Y. Lin Vincent Y. Lin Andrew Dimitrijevic Andrew Dimitrijevic Andrew Dimitrijevic |
| author_facet | Bowen Xiu Brandon T. Paul Joseph M. Chen Joseph M. Chen Trung N. Le Trung N. Le Vincent Y. Lin Vincent Y. Lin Andrew Dimitrijevic Andrew Dimitrijevic Andrew Dimitrijevic |
| author_sort | Bowen Xiu |
| collection | DOAJ |
| description | There is a weak relationship between clinical and self-reported speech perception outcomes in cochlear implant (CI) listeners. Such poor correspondence may be due to differences in clinical and “real-world” listening environments and stimuli. Speech in the real world is often accompanied by visual cues, background environmental noise, and is generally in a conversational context, all factors that could affect listening demand. Thus, our objectives were to determine if brain responses to naturalistic speech could index speech perception and listening demand in CI users. Accordingly, we recorded high-density electroencephalogram (EEG) while CI users listened/watched a naturalistic stimulus (i.e., the television show, “The Office”). We used continuous EEG to quantify “speech neural tracking” (i.e., TRFs, temporal response functions) to the show’s soundtrack and 8–12 Hz (alpha) brain rhythms commonly related to listening effort. Background noise at three different signal-to-noise ratios (SNRs), +5, +10, and +15 dB were presented to vary the difficulty of following the television show, mimicking a natural noisy environment. The task also included an audio-only (no video) condition. After each condition, participants subjectively rated listening demand and the degree of words and conversations they felt they understood. Fifteen CI users reported progressively higher degrees of listening demand and less words and conversation with increasing background noise. Listening demand and conversation understanding in the audio-only condition was comparable to that of the highest noise condition (+5 dB). Increasing background noise affected speech neural tracking at a group level, in addition to eliciting strong individual differences. Mixed effect modeling showed that listening demand and conversation understanding were correlated to early cortical speech tracking, such that high demand and low conversation understanding occurred with lower amplitude TRFs. In the high noise condition, greater listening demand was negatively correlated to parietal alpha power, where higher demand was related to lower alpha power. No significant correlations were observed between TRF/alpha and clinical speech perception scores. These results are similar to previous findings showing little relationship between clinical speech perception and quality-of-life in CI users. However, physiological responses to complex natural speech may provide an objective measure of aspects of quality-of-life measures like self-perceived listening demand. |
| first_indexed | 2024-04-12T08:30:07Z |
| format | Article |
| id | doaj.art-ed631889354e4298bf857c7038fc2bb7 |
| institution | Directory Open Access Journal |
| issn | 1662-5161 |
| language | English |
| last_indexed | 2024-04-12T08:30:07Z |
| publishDate | 2022-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Human Neuroscience |
| spelling | doaj.art-ed631889354e4298bf857c7038fc2bb72022-12-22T03:40:14ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612022-11-011610.3389/fnhum.2022.10434991043499Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant usersBowen Xiu0Brandon T. Paul1Joseph M. Chen2Joseph M. Chen3Trung N. Le4Trung N. Le5Vincent Y. Lin6Vincent Y. Lin7Andrew Dimitrijevic8Andrew Dimitrijevic9Andrew Dimitrijevic10Evaluative Clinical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, CanadaDepartment of Psychology, Toronto Metropolitan University, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Sunnybrook Health Sciences Centre, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Faculty of Medicine, University of Toronto, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Sunnybrook Health Sciences Centre, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Faculty of Medicine, University of Toronto, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Sunnybrook Health Sciences Centre, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Faculty of Medicine, University of Toronto, Toronto, ON, CanadaEvaluative Clinical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Sunnybrook Health Sciences Centre, Toronto, ON, CanadaDepartment of Otolaryngology – Head and Neck Surgery, Faculty of Medicine, University of Toronto, Toronto, ON, CanadaThere is a weak relationship between clinical and self-reported speech perception outcomes in cochlear implant (CI) listeners. Such poor correspondence may be due to differences in clinical and “real-world” listening environments and stimuli. Speech in the real world is often accompanied by visual cues, background environmental noise, and is generally in a conversational context, all factors that could affect listening demand. Thus, our objectives were to determine if brain responses to naturalistic speech could index speech perception and listening demand in CI users. Accordingly, we recorded high-density electroencephalogram (EEG) while CI users listened/watched a naturalistic stimulus (i.e., the television show, “The Office”). We used continuous EEG to quantify “speech neural tracking” (i.e., TRFs, temporal response functions) to the show’s soundtrack and 8–12 Hz (alpha) brain rhythms commonly related to listening effort. Background noise at three different signal-to-noise ratios (SNRs), +5, +10, and +15 dB were presented to vary the difficulty of following the television show, mimicking a natural noisy environment. The task also included an audio-only (no video) condition. After each condition, participants subjectively rated listening demand and the degree of words and conversations they felt they understood. Fifteen CI users reported progressively higher degrees of listening demand and less words and conversation with increasing background noise. Listening demand and conversation understanding in the audio-only condition was comparable to that of the highest noise condition (+5 dB). Increasing background noise affected speech neural tracking at a group level, in addition to eliciting strong individual differences. Mixed effect modeling showed that listening demand and conversation understanding were correlated to early cortical speech tracking, such that high demand and low conversation understanding occurred with lower amplitude TRFs. In the high noise condition, greater listening demand was negatively correlated to parietal alpha power, where higher demand was related to lower alpha power. No significant correlations were observed between TRF/alpha and clinical speech perception scores. These results are similar to previous findings showing little relationship between clinical speech perception and quality-of-life in CI users. However, physiological responses to complex natural speech may provide an objective measure of aspects of quality-of-life measures like self-perceived listening demand.https://www.frontiersin.org/articles/10.3389/fnhum.2022.1043499/fullspeech trackingEEGlistening in noiseattentiontemporal response functionmovies |
| spellingShingle | Bowen Xiu Brandon T. Paul Joseph M. Chen Joseph M. Chen Trung N. Le Trung N. Le Vincent Y. Lin Vincent Y. Lin Andrew Dimitrijevic Andrew Dimitrijevic Andrew Dimitrijevic Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users Frontiers in Human Neuroscience speech tracking EEG listening in noise attention temporal response function movies |
| title | Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users |
| title_full | Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users |
| title_fullStr | Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users |
| title_full_unstemmed | Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users |
| title_short | Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users |
| title_sort | neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users |
| topic | speech tracking EEG listening in noise attention temporal response function movies |
| url | https://www.frontiersin.org/articles/10.3389/fnhum.2022.1043499/full |
| work_keys_str_mv | AT bowenxiu neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT brandontpaul neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT josephmchen neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT josephmchen neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT trungnle neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT trungnle neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT vincentylin neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT vincentylin neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT andrewdimitrijevic neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT andrewdimitrijevic neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers AT andrewdimitrijevic neuralresponsestonaturalisticaudiovisualspeecharerelatedtolisteningdemandincochlearimplantusers |