Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network
While we know that motivated students learn better than non-motivated students but detecting motivation is challenging. Here we present a game-based motivation detection approach from the EEG signals. We take an original approach of using EEG-based brain computer interface to assess if motivation st...
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/162728 |
| _version_ | 1811677260861669376 |
|---|---|
| author | Chattopadhyay, Soham Zary, Laila Quek, Chai Prasad, Dilip K. |
| author2 | School of Computer Science and Engineering |
| author_facet | School of Computer Science and Engineering Chattopadhyay, Soham Zary, Laila Quek, Chai Prasad, Dilip K. |
| author_sort | Chattopadhyay, Soham |
| collection | NTU |
| description | While we know that motivated students learn better than non-motivated students but detecting motivation is challenging. Here we present a game-based motivation detection approach from the EEG signals. We take an original approach of using EEG-based brain computer interface to assess if motivation state is manifest in physiological EEG signals as well, and what are suitable conditions in order to achieve the goal? To the best of our knowledge, detection of motivation level from brain signals is proposed for the first time in this paper. In order to resolve the central obstacle of small EEG datasets containing deep features, we propose a novel and unique ‘residual-in-residual architecture of convolutional neural network (RRCNN)’ that is capable of reducing the problem of over-fitting on small datasets and vanishing gradient. Having accomplished this, several aspects of using EEG signals for motivation detection are considered, including channel selection and accuracy obtained using alpha or beta waves of EEG signals. We also include a detailed validation of the different aspects of our methodology, including detailed comparison with other works as relevant. Our approach achieves 89% accuracy in using EEG signals to detect motivation state while learning, where alpha wave signals of frontal asymmetry channels are employed. A more robust (less sensitive to learning conditions) 88% accuracy is achieved using beta waves signals of frontal asymmetry channels. The results clearly indicate the potential of detecting motivation states using EEG signals, provided suitable methodologies such as proposed in this paper, are employed. |
| first_indexed | 2024-10-01T02:34:33Z |
| format | Journal Article |
| id | ntu-10356/162728 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T02:34:33Z |
| publishDate | 2022 |
| record_format | dspace |
| spelling | ntu-10356/1627282022-11-07T06:50:19Z Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network Chattopadhyay, Soham Zary, Laila Quek, Chai Prasad, Dilip K. School of Computer Science and Engineering Engineering::Computer science and engineering Deep Learning EEG While we know that motivated students learn better than non-motivated students but detecting motivation is challenging. Here we present a game-based motivation detection approach from the EEG signals. We take an original approach of using EEG-based brain computer interface to assess if motivation state is manifest in physiological EEG signals as well, and what are suitable conditions in order to achieve the goal? To the best of our knowledge, detection of motivation level from brain signals is proposed for the first time in this paper. In order to resolve the central obstacle of small EEG datasets containing deep features, we propose a novel and unique ‘residual-in-residual architecture of convolutional neural network (RRCNN)’ that is capable of reducing the problem of over-fitting on small datasets and vanishing gradient. Having accomplished this, several aspects of using EEG signals for motivation detection are considered, including channel selection and accuracy obtained using alpha or beta waves of EEG signals. We also include a detailed validation of the different aspects of our methodology, including detailed comparison with other works as relevant. Our approach achieves 89% accuracy in using EEG signals to detect motivation state while learning, where alpha wave signals of frontal asymmetry channels are employed. A more robust (less sensitive to learning conditions) 88% accuracy is achieved using beta waves signals of frontal asymmetry channels. The results clearly indicate the potential of detecting motivation states using EEG signals, provided suitable methodologies such as proposed in this paper, are employed. Published version SC acknowledges internship funding support from Research Council Norway’s INTPART grant no. 309802 2022-11-07T06:50:19Z 2022-11-07T06:50:19Z 2021 Journal Article Chattopadhyay, S., Zary, L., Quek, C. & Prasad, D. K. (2021). Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network. Expert Systems With Applications, 184, 115548-. https://dx.doi.org/10.1016/j.eswa.2021.115548 0957-4174 https://hdl.handle.net/10356/162728 10.1016/j.eswa.2021.115548 2-s2.0-85109441674 184 115548 en Expert Systems with Applications © 2021 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). application/pdf |
| spellingShingle | Engineering::Computer science and engineering Deep Learning EEG Chattopadhyay, Soham Zary, Laila Quek, Chai Prasad, Dilip K. Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network |
| title | Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network |
| title_full | Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network |
| title_fullStr | Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network |
| title_full_unstemmed | Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network |
| title_short | Motivation detection using EEG signal analysis by residual-in-residual convolutional neural network |
| title_sort | motivation detection using eeg signal analysis by residual in residual convolutional neural network |
| topic | Engineering::Computer science and engineering Deep Learning EEG |
| url | https://hdl.handle.net/10356/162728 |
| work_keys_str_mv | AT chattopadhyaysoham motivationdetectionusingeegsignalanalysisbyresidualinresidualconvolutionalneuralnetwork AT zarylaila motivationdetectionusingeegsignalanalysisbyresidualinresidualconvolutionalneuralnetwork AT quekchai motivationdetectionusingeegsignalanalysisbyresidualinresidualconvolutionalneuralnetwork AT prasaddilipk motivationdetectionusingeegsignalanalysisbyresidualinresidualconvolutionalneuralnetwork |