Evaluation of Machine Learning Algorithms for Classification of EEG Signals

In brain–computer interfaces (BCIs), it is crucial to process brain signals to improve the accuracy of the classification of motor movements. Machine learning (ML) algorithms such as artificial neural networks (ANNs), linear discriminant analysis (LDA), decision tree (D.T.), K-nearest neighbor (KNN)...

Full description

Bibliographic Details
Main Authors: Francisco Javier Ramírez-Arias, Enrique Efren García-Guerrero, Esteban Tlelo-Cuautle, Juan Miguel Colores-Vargas, Eloisa García-Canseco, Oscar Roberto López-Bonilla, Gilberto Manuel Galindo-Aldana, Everardo Inzunza-González
Format: Article
Language:English
Published: MDPI AG 2022-06-01
Series:Technologies
Subjects:
Online Access:https://www.mdpi.com/2227-7080/10/4/79
_version_ 1797441655756816384
author Francisco Javier Ramírez-Arias
Enrique Efren García-Guerrero
Esteban Tlelo-Cuautle
Juan Miguel Colores-Vargas
Eloisa García-Canseco
Oscar Roberto López-Bonilla
Gilberto Manuel Galindo-Aldana
Everardo Inzunza-González
author_facet Francisco Javier Ramírez-Arias
Enrique Efren García-Guerrero
Esteban Tlelo-Cuautle
Juan Miguel Colores-Vargas
Eloisa García-Canseco
Oscar Roberto López-Bonilla
Gilberto Manuel Galindo-Aldana
Everardo Inzunza-González
author_sort Francisco Javier Ramírez-Arias
collection DOAJ
description In brain–computer interfaces (BCIs), it is crucial to process brain signals to improve the accuracy of the classification of motor movements. Machine learning (ML) algorithms such as artificial neural networks (ANNs), linear discriminant analysis (LDA), decision tree (D.T.), K-nearest neighbor (KNN), naive Bayes (N.B.), and support vector machine (SVM) have made significant progress in classification issues. This paper aims to present a signal processing analysis of electroencephalographic (EEG) signals among different feature extraction techniques to train selected classification algorithms to classify signals related to motor movements. The motor movements considered are related to the left hand, right hand, both fists, feet, and relaxation, making this a multiclass problem. In this study, nine ML algorithms were trained with a dataset created by the feature extraction of EEG signals.The EEG signals of 30 Physionet subjects were used to create a dataset related to movement. We used electrodes C3, C1, CZ, C2, and C4 according to the standard 10-10 placement. Then, we extracted the epochs of the EEG signals and applied tone, amplitude levels, and statistical techniques to obtain the set of features. LabVIEW™2015 version custom applications were used for reading the EEG signals; for channel selection, noise filtering, band selection, and feature extraction operations; and for creating the dataset. MATLAB 2021a was used for training, testing, and evaluating the performance metrics of the ML algorithms. In this study, the model of Medium-ANN achieved the best performance, with an AUC average of 0.9998, Cohen’s Kappa coefficient of 0.9552, a Matthews correlation coefficient of 0.9819, and a loss of 0.0147. These findings suggest the applicability of our approach to different scenarios, such as implementing robotic prostheses, where the use of superficial features is an acceptable option when resources are limited, as in embedded systems or edge computing devices.
first_indexed 2024-03-09T12:26:18Z
format Article
id doaj.art-f2cf375428da4424a22c506346e9d9d2
institution Directory Open Access Journal
issn 2227-7080
language English
last_indexed 2024-03-09T12:26:18Z
publishDate 2022-06-01
publisher MDPI AG
record_format Article
series Technologies
spelling doaj.art-f2cf375428da4424a22c506346e9d9d22023-11-30T22:34:54ZengMDPI AGTechnologies2227-70802022-06-011047910.3390/technologies10040079Evaluation of Machine Learning Algorithms for Classification of EEG SignalsFrancisco Javier Ramírez-Arias0Enrique Efren García-Guerrero1Esteban Tlelo-Cuautle2Juan Miguel Colores-Vargas3Eloisa García-Canseco4Oscar Roberto López-Bonilla5Gilberto Manuel Galindo-Aldana6Everardo Inzunza-González7Facultad de Ingeniería, Arquitectura y Diseño, Universidad Autónoma de Baja California, Carretera Transpeninsular Ensenada-Tijuana No. 3917, Ensenada 22860, MexicoFacultad de Ingeniería, Arquitectura y Diseño, Universidad Autónoma de Baja California, Carretera Transpeninsular Ensenada-Tijuana No. 3917, Ensenada 22860, MexicoDepartamento de Electrónica, Instituto Nacional de Astrofísica, Óptica y Electrónica, Luis Enrique Erro No. 1, Santa María Tonanzintla, Puebla 72840, MexicoFacultad de Ciencias de la Ingeniería y Tecnología, Universidad Autónoma de Baja California, Blvd. Universitario No. 1000, Valle de las Palmas, Tijuana 21500, MexicoFacultad de Ciencias, Universidad Autónoma de Baja California, Carretera Transpeninsular Ensenada-Tijuana No. 3917, Ensenada 22860, MexicoFacultad de Ingeniería, Arquitectura y Diseño, Universidad Autónoma de Baja California, Carretera Transpeninsular Ensenada-Tijuana No. 3917, Ensenada 22860, MexicoFacultad de Ingeniería y Negocios, Guadalupe Victoria, Universidad Autónoma de Baja California, Carretera Estatal No. 3, Gutiérrez, Mexicali 21720, MexicoFacultad de Ingeniería, Arquitectura y Diseño, Universidad Autónoma de Baja California, Carretera Transpeninsular Ensenada-Tijuana No. 3917, Ensenada 22860, MexicoIn brain–computer interfaces (BCIs), it is crucial to process brain signals to improve the accuracy of the classification of motor movements. Machine learning (ML) algorithms such as artificial neural networks (ANNs), linear discriminant analysis (LDA), decision tree (D.T.), K-nearest neighbor (KNN), naive Bayes (N.B.), and support vector machine (SVM) have made significant progress in classification issues. This paper aims to present a signal processing analysis of electroencephalographic (EEG) signals among different feature extraction techniques to train selected classification algorithms to classify signals related to motor movements. The motor movements considered are related to the left hand, right hand, both fists, feet, and relaxation, making this a multiclass problem. In this study, nine ML algorithms were trained with a dataset created by the feature extraction of EEG signals.The EEG signals of 30 Physionet subjects were used to create a dataset related to movement. We used electrodes C3, C1, CZ, C2, and C4 according to the standard 10-10 placement. Then, we extracted the epochs of the EEG signals and applied tone, amplitude levels, and statistical techniques to obtain the set of features. LabVIEW™2015 version custom applications were used for reading the EEG signals; for channel selection, noise filtering, band selection, and feature extraction operations; and for creating the dataset. MATLAB 2021a was used for training, testing, and evaluating the performance metrics of the ML algorithms. In this study, the model of Medium-ANN achieved the best performance, with an AUC average of 0.9998, Cohen’s Kappa coefficient of 0.9552, a Matthews correlation coefficient of 0.9819, and a loss of 0.0147. These findings suggest the applicability of our approach to different scenarios, such as implementing robotic prostheses, where the use of superficial features is an acceptable option when resources are limited, as in embedded systems or edge computing devices.https://www.mdpi.com/2227-7080/10/4/79EEGBCIfeature extractionartificial intelligencemachine learningdeep learning
spellingShingle Francisco Javier Ramírez-Arias
Enrique Efren García-Guerrero
Esteban Tlelo-Cuautle
Juan Miguel Colores-Vargas
Eloisa García-Canseco
Oscar Roberto López-Bonilla
Gilberto Manuel Galindo-Aldana
Everardo Inzunza-González
Evaluation of Machine Learning Algorithms for Classification of EEG Signals
Technologies
EEG
BCI
feature extraction
artificial intelligence
machine learning
deep learning
title Evaluation of Machine Learning Algorithms for Classification of EEG Signals
title_full Evaluation of Machine Learning Algorithms for Classification of EEG Signals
title_fullStr Evaluation of Machine Learning Algorithms for Classification of EEG Signals
title_full_unstemmed Evaluation of Machine Learning Algorithms for Classification of EEG Signals
title_short Evaluation of Machine Learning Algorithms for Classification of EEG Signals
title_sort evaluation of machine learning algorithms for classification of eeg signals
topic EEG
BCI
feature extraction
artificial intelligence
machine learning
deep learning
url https://www.mdpi.com/2227-7080/10/4/79
work_keys_str_mv AT franciscojavierramirezarias evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT enriqueefrengarciaguerrero evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT estebantlelocuautle evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT juanmiguelcoloresvargas evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT eloisagarciacanseco evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT oscarrobertolopezbonilla evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT gilbertomanuelgalindoaldana evaluationofmachinelearningalgorithmsforclassificationofeegsignals
AT everardoinzunzagonzalez evaluationofmachinelearningalgorithmsforclassificationofeegsignals