Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state

This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials elicited in different modalities for use in brain-computer interface systems. Such sy...

Full description

Bibliographic Details
Main Authors: Tobias eKaufmann, Elisa Mira Holz, Andrea eKübler
Format: Article
Language:English
Published: Frontiers Media S.A. 2013-07-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00129/full
_version_ 1818608317340057600
author Tobias eKaufmann
Elisa Mira Holz
Andrea eKübler
author_facet Tobias eKaufmann
Elisa Mira Holz
Andrea eKübler
author_sort Tobias eKaufmann
collection DOAJ
description This paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials elicited in different modalities for use in brain-computer interface systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g. partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study.
first_indexed 2024-12-16T14:40:43Z
format Article
id doaj.art-a38427df364040cca0f9c24c66c93842
institution Directory Open Access Journal
issn 1662-453X
language English
last_indexed 2024-12-16T14:40:43Z
publishDate 2013-07-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Neuroscience
spelling doaj.art-a38427df364040cca0f9c24c66c938422022-12-21T22:27:56ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2013-07-01710.3389/fnins.2013.0012951392Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in stateTobias eKaufmann0Elisa Mira Holz1Andrea eKübler2Julius-Maximilian University of WürzburgJulius-Maximilian University of WürzburgJulius-Maximilian University of WürzburgThis paper describes a case study with a patient in the classic locked-in state, who currently has no means of independent communication. Following a user-centered approach, we investigated event-related potentials elicited in different modalities for use in brain-computer interface systems. Such systems could provide her with an alternative communication channel. To investigate the most viable modality for achieving BCI based communication, classic oddball paradigms (1 rare and 1 frequent stimulus, ratio 1:5) in the visual, auditory and tactile modality were conducted (2 runs per modality). Classifiers were built on one run and tested offline on another run (and vice versa). In these paradigms, the tactile modality was clearly superior to other modalities, displaying high offline accuracy even when classification was performed on single trials only. Consequently, we tested the tactile paradigm online and the patient successfully selected targets without any error. Furthermore, we investigated use of the visual or tactile modality for different BCI systems with more than two selection options. In the visual modality, several BCI paradigms were tested offline. Neither matrix-based nor so-called gaze-independent paradigms constituted a means of control. These results may thus question the gaze-independence of current gaze-independent approaches to BCI. A tactile four-choice BCI resulted in high offline classification accuracies. Yet, online use raised various issues. Although performance was clearly above chance, practical daily life use appeared unlikely when compared to other communication approaches (e.g. partner scanning). Our results emphasize the need for user-centered design in BCI development including identification of the best stimulus modality for a particular user. Finally, the paper discusses feasibility of EEG-based BCI systems for patients in classic locked-in state and compares BCI to other AT solutions that we also tested during the study.http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00129/fullauditoryvisualBrain-computer interfacetactilelocked-in syndromemodality
spellingShingle Tobias eKaufmann
Elisa Mira Holz
Andrea eKübler
Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
Frontiers in Neuroscience
auditory
visual
Brain-computer interface
tactile
locked-in syndrome
modality
title Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
title_full Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
title_fullStr Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
title_full_unstemmed Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
title_short Comparison of tactile, auditory and visual modality for brain-computer interface use: A case study with a patient in the locked-in state
title_sort comparison of tactile auditory and visual modality for brain computer interface use a case study with a patient in the locked in state
topic auditory
visual
Brain-computer interface
tactile
locked-in syndrome
modality
url http://journal.frontiersin.org/Journal/10.3389/fnins.2013.00129/full
work_keys_str_mv AT tobiasekaufmann comparisonoftactileauditoryandvisualmodalityforbraincomputerinterfaceuseacasestudywithapatientinthelockedinstate
AT elisamiraholz comparisonoftactileauditoryandvisualmodalityforbraincomputerinterfaceuseacasestudywithapatientinthelockedinstate
AT andreaekubler comparisonoftactileauditoryandvisualmodalityforbraincomputerinterfaceuseacasestudywithapatientinthelockedinstate