Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials elicited in different modalities for use in brain-computer interface systems. Such sy...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2013-07-01
|
Series: | Frontiers in Neuroscience |
Subjects: | |
Online Access: | http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00129/full |
_version_ | 1818608317340057600 |
---|---|
author | Tobias eKaufmann Elisa Mira Holz Andrea eKübler |
author_facet | Tobias eKaufmann Elisa Mira Holz Andrea eKübler |
author_sort | Tobias eKaufmann |
collection | DOAJ |
description | This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials elicited in different modalities for use in brain-computer interface systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g. partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study. |
first_indexed | 2024-12-16T14:40:43Z |
format | Article |
id | doaj.art-a38427df364040cca0f9c24c66c93842 |
institution | Directory Open Access Journal |
issn | 1662-453X |
language | English |
last_indexed | 2024-12-16T14:40:43Z |
publishDate | 2013-07-01 |
publisher | Frontiers Media S.A. |
record_format | Article |
series | Frontiers in Neuroscience |
spelling | doaj.art-a38427df364040cca0f9c24c66c938422022-12-21T22:27:56ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2013-07-01710.3389/fnins.2013.0012951392Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in stateTobias eKaufmann0Elisa Mira Holz1Andrea eKübler2Julius-Maximilian University of WürzburgJulius-Maximilian University of WürzburgJulius-Maximilian University of WürzburgThis paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials elicited in different modalities for use in brain-computer interface systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g. partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study.http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00129/fullauditoryvisualBrain-computer interfacetactilelocked-in syndromemodality |
spellingShingle | Tobias eKaufmann Elisa Mira Holz Andrea eKübler Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state Frontiers in Neuroscience auditory visual Brain-computer interface tactile locked-in syndrome modality |
title | Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state |
title_full | Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state |
title_fullStr | Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state |
title_full_unstemmed | Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state |
title_short | Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state |
title_sort | comparison of tactile auditory and visual modality for brain computer interface use a case study with a patient in the locked in state |
topic | auditory visual Brain-computer interface tactile locked-in syndrome modality |
url | http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00129/full |
work_keys_str_mv | AT tobiasekaufmann comparisonoftactileauditoryandvisualmodalityforbraincomputerinterfaceuseacasestudywithapatientinthelockedinstate AT elisamiraholz comparisonoftactileauditoryandvisualmodalityforbraincomputerinterfaceuseacasestudywithapatientinthelockedinstate AT andreaekubler comparisonoftactileauditoryandvisualmodalityforbraincomputerinterfaceuseacasestudywithapatientinthelockedinstate |