Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces
Abstract Brain-computer interfaces (BCIs) have attracted considerable attention in motor and language rehabilitation. Most devices use cap-based non-invasive, headband-based commercial products or microneedle-based invasive approaches, which are constrained for inconvenience, limited applications, i...
| Main Authors: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-07-01
|
| Series: | Nature Communications |
| Online Access: | https://doi.org/10.1038/s41467-023-39814-6 |
| _version_ | 1797778747913404416 |
|---|---|
| author | Zhouheng Wang Nanlin Shi Yingchao Zhang Ning Zheng Haicheng Li Yang Jiao Jiahui Cheng Yutong Wang Xiaoqing Zhang Ying Chen Yihao Chen Heling Wang Tao Xie Yijun Wang Yinji Ma Xiaorong Gao Xue Feng |
| author_facet | Zhouheng Wang Nanlin Shi Yingchao Zhang Ning Zheng Haicheng Li Yang Jiao Jiahui Cheng Yutong Wang Xiaoqing Zhang Ying Chen Yihao Chen Heling Wang Tao Xie Yijun Wang Yinji Ma Xiaorong Gao Xue Feng |
| author_sort | Zhouheng Wang |
| collection | DOAJ |
| description | Abstract Brain-computer interfaces (BCIs) have attracted considerable attention in motor and language rehabilitation. Most devices use cap-based non-invasive, headband-based commercial products or microneedle-based invasive approaches, which are constrained for inconvenience, limited applications, inflammation risks and even irreversible damage to soft tissues. Here, we propose in-ear visual and auditory BCIs based on in-ear bioelectronics, named as SpiralE, which can adaptively expand and spiral along the auditory meatus under electrothermal actuation to ensure conformal contact. Participants achieve offline accuracies of 95% in 9-target steady state visual evoked potential (SSVEP) BCI classification and type target phrases successfully in a calibration-free 40-target online SSVEP speller experiment. Interestingly, in-ear SSVEPs exhibit significant 2nd harmonic tendencies, indicating that in-ear sensing may be complementary for studying harmonic spatial distributions in SSVEP studies. Moreover, natural speech auditory classification accuracy can reach 84% in cocktail party experiments. The SpiralE provides innovative concepts for designing 3D flexible bioelectronics and assists the development of biomedical engineering and neural monitoring. |
| first_indexed | 2024-03-12T23:22:00Z |
| format | Article |
| id | doaj.art-232d5da6867843cb9bfa35bc1e959ff6 |
| institution | Directory Open Access Journal |
| issn | 2041-1723 |
| language | English |
| last_indexed | 2024-03-12T23:22:00Z |
| publishDate | 2023-07-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Nature Communications |
| spelling | doaj.art-232d5da6867843cb9bfa35bc1e959ff62023-07-16T11:21:57ZengNature PortfolioNature Communications2041-17232023-07-0114111110.1038/s41467-023-39814-6Conformal in-ear bioelectronics for visual and auditory brain-computer interfacesZhouheng Wang0Nanlin Shi1Yingchao Zhang2Ning Zheng3Haicheng Li4Yang Jiao5Jiahui Cheng6Yutong Wang7Xiaoqing Zhang8Ying Chen9Yihao Chen10Heling Wang11Tao Xie12Yijun Wang13Yinji Ma14Xiaorong Gao15Xue Feng16Laboratory of Flexible Electronics Technology, Tsinghua UniversityDepartment of Biomedical Engineering, Tsinghua UniversityAML, Department of Engineering Mechanics, Tsinghua UniversityState Key Laboratory of Chemical Engineering, College of Chemical and Biological Engineering, Zhejiang UniversityLaboratory of Flexible Electronics Technology, Tsinghua UniversityLaboratory of Flexible Electronics Technology, Tsinghua UniversityLaboratory of Flexible Electronics Technology, Tsinghua UniversityLaboratory of Flexible Electronics Technology, Tsinghua UniversityDepartment of Otolaryngology-Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical UniversityInstitute of Flexible Electronics Technology of THULaboratory of Flexible Electronics Technology, Tsinghua UniversityLaboratory of Flexible Electronics Technology, Tsinghua UniversityState Key Laboratory of Chemical Engineering, College of Chemical and Biological Engineering, Zhejiang UniversityInstitute of Semiconductors, Chinese Academy of SciencesLaboratory of Flexible Electronics Technology, Tsinghua UniversityDepartment of Biomedical Engineering, Tsinghua UniversityLaboratory of Flexible Electronics Technology, Tsinghua UniversityAbstract Brain-computer interfaces (BCIs) have attracted considerable attention in motor and language rehabilitation. Most devices use cap-based non-invasive, headband-based commercial products or microneedle-based invasive approaches, which are constrained for inconvenience, limited applications, inflammation risks and even irreversible damage to soft tissues. Here, we propose in-ear visual and auditory BCIs based on in-ear bioelectronics, named as SpiralE, which can adaptively expand and spiral along the auditory meatus under electrothermal actuation to ensure conformal contact. Participants achieve offline accuracies of 95% in 9-target steady state visual evoked potential (SSVEP) BCI classification and type target phrases successfully in a calibration-free 40-target online SSVEP speller experiment. Interestingly, in-ear SSVEPs exhibit significant 2nd harmonic tendencies, indicating that in-ear sensing may be complementary for studying harmonic spatial distributions in SSVEP studies. Moreover, natural speech auditory classification accuracy can reach 84% in cocktail party experiments. The SpiralE provides innovative concepts for designing 3D flexible bioelectronics and assists the development of biomedical engineering and neural monitoring.https://doi.org/10.1038/s41467-023-39814-6 |
| spellingShingle | Zhouheng Wang Nanlin Shi Yingchao Zhang Ning Zheng Haicheng Li Yang Jiao Jiahui Cheng Yutong Wang Xiaoqing Zhang Ying Chen Yihao Chen Heling Wang Tao Xie Yijun Wang Yinji Ma Xiaorong Gao Xue Feng Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces Nature Communications |
| title | Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces |
| title_full | Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces |
| title_fullStr | Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces |
| title_full_unstemmed | Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces |
| title_short | Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces |
| title_sort | conformal in ear bioelectronics for visual and auditory brain computer interfaces |
| url | https://doi.org/10.1038/s41467-023-39814-6 |
| work_keys_str_mv | AT zhouhengwang conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT nanlinshi conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yingchaozhang conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT ningzheng conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT haichengli conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yangjiao conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT jiahuicheng conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yutongwang conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT xiaoqingzhang conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yingchen conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yihaochen conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT helingwang conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT taoxie conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yijunwang conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT yinjima conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT xiaoronggao conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces AT xuefeng conformalinearbioelectronicsforvisualandauditorybraincomputerinterfaces |