Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models
Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique used to estimate brain activity by measuring local hemodynamic changes. Due to its high spatial resolution, fNIRS is being actively researched as a control signal in the field of brain-computer interface (BCI). Extraction of e...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10343167/ |
| _version_ | 1827398935839244288 |
|---|---|
| author | Minseok Seo Eugene Jeong Kyung-Soo Kim |
| author_facet | Minseok Seo Eugene Jeong Kyung-Soo Kim |
| author_sort | Minseok Seo |
| collection | DOAJ |
| description | Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique used to estimate brain activity by measuring local hemodynamic changes. Due to its high spatial resolution, fNIRS is being actively researched as a control signal in the field of brain-computer interface (BCI). Extraction of effective features and accurate classification of signals have always been the focus of research. Previous studies have often converted fNIRS data into images based on the relative positions of the measurement channels and utilized convolutional neural networks (CNN) for classification. However, image representation cannot fully express the non-Euclidean characteristics of the brain signal. In this paper, we propose an approach for single-trial, multi-class fNIRS classification using a graph representation and a graph neural network (GNN). Specifically, a class-specific graph was constructed for each class to incorporate both positional and task-dependent functional connectivity (FC) information. The GNN-based models were then trained on each of the obtained class-specific graphs to have specificity for the corresponding class. Finally, the stacking ensemble learning with a gating network was introduced to weight the models for the final prediction. The proposed method was evaluated on a public dataset consisting of three types of overt movements. The results were compared with baseline models based on support vector machine (SVM) and CNN, using different image conversion methods. The best-performing baseline model achieved an average ternary classification accuracy of 68.71%, whereas the proposed model achieved a classification accuracy of 72.31% for the single model, and 75.47% for the ensemble model. |
| first_indexed | 2024-03-08T19:37:00Z |
| format | Article |
| id | doaj.art-14417976fc5e4de5ad508cc75f0f54be |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T19:37:00Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-14417976fc5e4de5ad508cc75f0f54be2023-12-26T00:08:27ZengIEEEIEEE Access2169-35362023-01-011113760613762010.1109/ACCESS.2023.333964710343167Multi-Class fNIRS Classification Using an Ensemble of GNN-Based ModelsMinseok Seo0https://orcid.org/0009-0008-6299-3577Eugene Jeong1https://orcid.org/0009-0004-7355-0182Kyung-Soo Kim2https://orcid.org/0000-0003-4856-1096Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of KoreaDepartment of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of KoreaDepartment of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Yuseong-gu, Daejeon, Republic of KoreaFunctional near-infrared spectroscopy (fNIRS) is a neuroimaging technique used to estimate brain activity by measuring local hemodynamic changes. Due to its high spatial resolution, fNIRS is being actively researched as a control signal in the field of brain-computer interface (BCI). Extraction of effective features and accurate classification of signals have always been the focus of research. Previous studies have often converted fNIRS data into images based on the relative positions of the measurement channels and utilized convolutional neural networks (CNN) for classification. However, image representation cannot fully express the non-Euclidean characteristics of the brain signal. In this paper, we propose an approach for single-trial, multi-class fNIRS classification using a graph representation and a graph neural network (GNN). Specifically, a class-specific graph was constructed for each class to incorporate both positional and task-dependent functional connectivity (FC) information. The GNN-based models were then trained on each of the obtained class-specific graphs to have specificity for the corresponding class. Finally, the stacking ensemble learning with a gating network was introduced to weight the models for the final prediction. The proposed method was evaluated on a public dataset consisting of three types of overt movements. The results were compared with baseline models based on support vector machine (SVM) and CNN, using different image conversion methods. The best-performing baseline model achieved an average ternary classification accuracy of 68.71%, whereas the proposed model achieved a classification accuracy of 72.31% for the single model, and 75.47% for the ensemble model.https://ieeexplore.ieee.org/document/10343167/Brain-computer interfaceensemble learningfunctional connectivityfunctional near-infrared spectroscopygraph neural network |
| spellingShingle | Minseok Seo Eugene Jeong Kyung-Soo Kim Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models IEEE Access Brain-computer interface ensemble learning functional connectivity functional near-infrared spectroscopy graph neural network |
| title | Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models |
| title_full | Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models |
| title_fullStr | Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models |
| title_full_unstemmed | Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models |
| title_short | Multi-Class fNIRS Classification Using an Ensemble of GNN-Based Models |
| title_sort | multi class fnirs classification using an ensemble of gnn based models |
| topic | Brain-computer interface ensemble learning functional connectivity functional near-infrared spectroscopy graph neural network |
| url | https://ieeexplore.ieee.org/document/10343167/ |
| work_keys_str_mv | AT minseokseo multiclassfnirsclassificationusinganensembleofgnnbasedmodels AT eugenejeong multiclassfnirsclassificationusinganensembleofgnnbasedmodels AT kyungsookim multiclassfnirsclassificationusinganensembleofgnnbasedmodels |