Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses
“Locked-in” patients lose their ability to communicate naturally due to motor system dysfunction. Brain-computer interfacing offers a solution for their inability to communicate by enabling motor-independent communication. Straightforward and convenient in-session communication is essential in clini...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2020-04-01
|
| Series: | Frontiers in Human Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fnhum.2020.00113/full |
| _version_ | 1819065418247045120 |
|---|---|
| author | Laurien Nagels-Coune Laurien Nagels-Coune Laurien Nagels-Coune Amaia Benitez-Andonegui Amaia Benitez-Andonegui Niels Reuter Niels Reuter Michael Lührs Rainer Goebel Rainer Goebel Rainer Goebel Peter De Weerd Peter De Weerd Peter De Weerd Lars Riecke Lars Riecke Bettina Sorger Bettina Sorger |
| author_facet | Laurien Nagels-Coune Laurien Nagels-Coune Laurien Nagels-Coune Amaia Benitez-Andonegui Amaia Benitez-Andonegui Niels Reuter Niels Reuter Michael Lührs Rainer Goebel Rainer Goebel Rainer Goebel Peter De Weerd Peter De Weerd Peter De Weerd Lars Riecke Lars Riecke Bettina Sorger Bettina Sorger |
| author_sort | Laurien Nagels-Coune |
| collection | DOAJ |
| description | “Locked-in” patients lose their ability to communicate naturally due to motor system dysfunction. Brain-computer interfacing offers a solution for their inability to communicate by enabling motor-independent communication. Straightforward and convenient in-session communication is essential in clinical environments. The present study introduces a functional near-infrared spectroscopy (fNIRS)-based binary communication paradigm that requires limited preparation time and merely nine optodes. Eighteen healthy participants performed two mental imagery tasks, mental drawing and spatial navigation, to answer yes/no questions during one of two auditorily cued time windows. Each of the six questions was answered five times, resulting in five trials per answer. This communication paradigm thus combines both spatial (two different mental imagery tasks, here mental drawing for “yes” and spatial navigation for “no”) and temporal (distinct time windows for encoding a “yes” and “no” answer) fNIRS signal features for information encoding. Participants’ answers were decoded in simulated real-time using general linear model analysis. Joint analysis of all five encoding trials resulted in an average accuracy of 66.67 and 58.33% using the oxygenated (HbO) and deoxygenated (HbR) hemoglobin signal respectively. For half of the participants, an accuracy of 83.33% or higher was reached using either the HbO signal or the HbR signal. For four participants, effective communication with 100% accuracy was achieved using either the HbO or HbR signal. An explorative analysis investigated the differentiability of the two mental tasks based solely on spatial fNIRS signal features. Using multivariate pattern analysis (MVPA) group single-trial accuracies of 58.33% (using 20 training trials per task) and 60.56% (using 40 training trials per task) could be obtained. Combining the five trials per run using a majority voting approach heightened these MVPA accuracies to 62.04 and 75%. Additionally, an fNIRS suitability questionnaire capturing participants’ physical features was administered to explore its predictive value for evaluating general data quality. Obtained questionnaire scores correlated significantly (r = -0.499) with the signal-to-noise of the raw light intensities. While more work is needed to further increase decoding accuracy, this study shows the potential of answer encoding using spatiotemporal fNIRS signal features or spatial fNIRS signal features only. |
| first_indexed | 2024-12-21T15:46:09Z |
| format | Article |
| id | doaj.art-f3db78f1c24f4bf4a685080bea50e455 |
| institution | Directory Open Access Journal |
| issn | 1662-5161 |
| language | English |
| last_indexed | 2024-12-21T15:46:09Z |
| publishDate | 2020-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Human Neuroscience |
| spelling | doaj.art-f3db78f1c24f4bf4a685080bea50e4552022-12-21T18:58:21ZengFrontiers Media S.A.Frontiers in Human Neuroscience1662-51612020-04-011410.3389/fnhum.2020.00113522380Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS ResponsesLaurien Nagels-Coune0Laurien Nagels-Coune1Laurien Nagels-Coune2Amaia Benitez-Andonegui3Amaia Benitez-Andonegui4Niels Reuter5Niels Reuter6Michael Lührs7Rainer Goebel8Rainer Goebel9Rainer Goebel10Peter De Weerd11Peter De Weerd12Peter De Weerd13Lars Riecke14Lars Riecke15Bettina Sorger16Bettina Sorger17Department of Cognitive Neuroscience, Maastricht University, Maastricht, NetherlandsMaastricht Brain Imaging Center, Maastricht, NetherlandsUniversity Psychiatric Centre Sint-Kamillus, Bierbeek, BelgiumDepartment of Cognitive Neuroscience, Maastricht University, Maastricht, NetherlandsMaastricht Brain Imaging Center, Maastricht, NetherlandsInstitute of Systems Neuroscience, Heinrich-Heine University, Düsseldorf, GermanyInstitute of Neuroscience and Medicine (INM-7), Research Centre Jülich, Jülich, GermanyBrain Innovation B.V., Maastricht, NetherlandsDepartment of Cognitive Neuroscience, Maastricht University, Maastricht, NetherlandsMaastricht Brain Imaging Center, Maastricht, NetherlandsBrain Innovation B.V., Maastricht, NetherlandsDepartment of Cognitive Neuroscience, Maastricht University, Maastricht, NetherlandsMaastricht Brain Imaging Center, Maastricht, NetherlandsMaastricht Centre for Systems Biology (MaCSBio), Maastricht University, Maastricht, NetherlandsDepartment of Cognitive Neuroscience, Maastricht University, Maastricht, NetherlandsMaastricht Brain Imaging Center, Maastricht, NetherlandsDepartment of Cognitive Neuroscience, Maastricht University, Maastricht, NetherlandsMaastricht Brain Imaging Center, Maastricht, Netherlands“Locked-in” patients lose their ability to communicate naturally due to motor system dysfunction. Brain-computer interfacing offers a solution for their inability to communicate by enabling motor-independent communication. Straightforward and convenient in-session communication is essential in clinical environments. The present study introduces a functional near-infrared spectroscopy (fNIRS)-based binary communication paradigm that requires limited preparation time and merely nine optodes. Eighteen healthy participants performed two mental imagery tasks, mental drawing and spatial navigation, to answer yes/no questions during one of two auditorily cued time windows. Each of the six questions was answered five times, resulting in five trials per answer. This communication paradigm thus combines both spatial (two different mental imagery tasks, here mental drawing for “yes” and spatial navigation for “no”) and temporal (distinct time windows for encoding a “yes” and “no” answer) fNIRS signal features for information encoding. Participants’ answers were decoded in simulated real-time using general linear model analysis. Joint analysis of all five encoding trials resulted in an average accuracy of 66.67 and 58.33% using the oxygenated (HbO) and deoxygenated (HbR) hemoglobin signal respectively. For half of the participants, an accuracy of 83.33% or higher was reached using either the HbO signal or the HbR signal. For four participants, effective communication with 100% accuracy was achieved using either the HbO or HbR signal. An explorative analysis investigated the differentiability of the two mental tasks based solely on spatial fNIRS signal features. Using multivariate pattern analysis (MVPA) group single-trial accuracies of 58.33% (using 20 training trials per task) and 60.56% (using 40 training trials per task) could be obtained. Combining the five trials per run using a majority voting approach heightened these MVPA accuracies to 62.04 and 75%. Additionally, an fNIRS suitability questionnaire capturing participants’ physical features was administered to explore its predictive value for evaluating general data quality. Obtained questionnaire scores correlated significantly (r = -0.499) with the signal-to-noise of the raw light intensities. While more work is needed to further increase decoding accuracy, this study shows the potential of answer encoding using spatiotemporal fNIRS signal features or spatial fNIRS signal features only.https://www.frontiersin.org/article/10.3389/fnhum.2020.00113/fullfunctional near infrared spectroscopy (fNIRS)brain computer interfacemental imagerymental drawingmotor imageryspatial navigation |
| spellingShingle | Laurien Nagels-Coune Laurien Nagels-Coune Laurien Nagels-Coune Amaia Benitez-Andonegui Amaia Benitez-Andonegui Niels Reuter Niels Reuter Michael Lührs Rainer Goebel Rainer Goebel Rainer Goebel Peter De Weerd Peter De Weerd Peter De Weerd Lars Riecke Lars Riecke Bettina Sorger Bettina Sorger Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses Frontiers in Human Neuroscience functional near infrared spectroscopy (fNIRS) brain computer interface mental imagery mental drawing motor imagery spatial navigation |
| title | Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses |
| title_full | Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses |
| title_fullStr | Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses |
| title_full_unstemmed | Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses |
| title_short | Brain-Based Binary Communication Using Spatiotemporal Features of fNIRS Responses |
| title_sort | brain based binary communication using spatiotemporal features of fnirs responses |
| topic | functional near infrared spectroscopy (fNIRS) brain computer interface mental imagery mental drawing motor imagery spatial navigation |
| url | https://www.frontiersin.org/article/10.3389/fnhum.2020.00113/full |
| work_keys_str_mv | AT lauriennagelscoune brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT lauriennagelscoune brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT lauriennagelscoune brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT amaiabenitezandonegui brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT amaiabenitezandonegui brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT nielsreuter brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT nielsreuter brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT michaelluhrs brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT rainergoebel brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT rainergoebel brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT rainergoebel brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT peterdeweerd brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT peterdeweerd brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT peterdeweerd brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT larsriecke brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT larsriecke brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT bettinasorger brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses AT bettinasorger brainbasedbinarycommunicationusingspatiotemporalfeaturesoffnirsresponses |