A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder

Abstract Prediction of response to Repetitive Transcranial Magnetic Stimulation (rTMS) can build a very effective treatment platform that helps Major Depressive Disorder (MDD) patients to receive timely treatment. We proposed a deep learning model powered up by state-of-the-art methods to classify r...

Full description

Bibliographic Details
Main Authors: Mohsen Sadat Shahabi, Ahmad Shalbaf, Reza Rostami, Reza Kazemi
Format: Article
Language:English
Published: Nature Portfolio 2023-06-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-023-35545-2
_version_ 1797795693893517312
author Mohsen Sadat Shahabi
Ahmad Shalbaf
Reza Rostami
Reza Kazemi
author_facet Mohsen Sadat Shahabi
Ahmad Shalbaf
Reza Rostami
Reza Kazemi
author_sort Mohsen Sadat Shahabi
collection DOAJ
description Abstract Prediction of response to Repetitive Transcranial Magnetic Stimulation (rTMS) can build a very effective treatment platform that helps Major Depressive Disorder (MDD) patients to receive timely treatment. We proposed a deep learning model powered up by state-of-the-art methods to classify responders (R) and non-responders (NR) to rTMS treatment. Pre-treatment Electro-Encephalogram (EEG) signal of public TDBRAIN dataset and 46 proprietary MDD subjects were utilized to create time–frequency representations using Continuous Wavelet Transform (CWT) to be fed into the two powerful pre-trained Convolutional Neural Networks (CNN) named VGG16 and EfficientNetB0. Equipping these Transfer Learning (TL) models with Bidirectional Long Short-Term Memory (BLSTM) and attention mechanism for the extraction of most discriminative spatiotemporal features from input images, can lead to superior performance in the prediction of rTMS treatment outcome. Five brain regions named Frontal, Central, Parietal, Temporal, and occipital were assessed and the highest evaluated performance in 46 proprietary MDD subjects was acquired for the Frontal region using the TL-LSTM-Attention model based on EfficientNetB0 with accuracy, sensitivity, specificity, and Area Under the Curve (AUC) of 97.1%, 97.3%, 97.0%, and 0.96 respectively. Additionally, to test the generalizability of the proposed models, these TL-BLSTM-Attention models were evaluated on a public dataset called TDBRAIN and the highest accuracy of 82.3%, the sensitivity of 80.2%, the specificity of 81.9% and the AUC of 0.83 were obtained. Therefore, advanced deep learning methods using a time–frequency representation of EEG signals from the frontal brain region and the convolutional recurrent neural networks equipped with the attention mechanism can construct an accurate platform for the prediction of response to the rTMS treatment.
first_indexed 2024-03-13T03:21:53Z
format Article
id doaj.art-1bb088ecc36c485b8699d07d3b10aca3
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-03-13T03:21:53Z
publishDate 2023-06-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-1bb088ecc36c485b8699d07d3b10aca32023-06-25T11:17:14ZengNature PortfolioScientific Reports2045-23222023-06-0113111410.1038/s41598-023-35545-2A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorderMohsen Sadat Shahabi0Ahmad Shalbaf1Reza Rostami2Reza Kazemi3Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical SciencesDepartment of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical SciencesDepartment of Psychology, University of TehranDepartment of Cognitive Psychology, Institute for Cognitive Science StudiesAbstract Prediction of response to Repetitive Transcranial Magnetic Stimulation (rTMS) can build a very effective treatment platform that helps Major Depressive Disorder (MDD) patients to receive timely treatment. We proposed a deep learning model powered up by state-of-the-art methods to classify responders (R) and non-responders (NR) to rTMS treatment. Pre-treatment Electro-Encephalogram (EEG) signal of public TDBRAIN dataset and 46 proprietary MDD subjects were utilized to create time–frequency representations using Continuous Wavelet Transform (CWT) to be fed into the two powerful pre-trained Convolutional Neural Networks (CNN) named VGG16 and EfficientNetB0. Equipping these Transfer Learning (TL) models with Bidirectional Long Short-Term Memory (BLSTM) and attention mechanism for the extraction of most discriminative spatiotemporal features from input images, can lead to superior performance in the prediction of rTMS treatment outcome. Five brain regions named Frontal, Central, Parietal, Temporal, and occipital were assessed and the highest evaluated performance in 46 proprietary MDD subjects was acquired for the Frontal region using the TL-LSTM-Attention model based on EfficientNetB0 with accuracy, sensitivity, specificity, and Area Under the Curve (AUC) of 97.1%, 97.3%, 97.0%, and 0.96 respectively. Additionally, to test the generalizability of the proposed models, these TL-BLSTM-Attention models were evaluated on a public dataset called TDBRAIN and the highest accuracy of 82.3%, the sensitivity of 80.2%, the specificity of 81.9% and the AUC of 0.83 were obtained. Therefore, advanced deep learning methods using a time–frequency representation of EEG signals from the frontal brain region and the convolutional recurrent neural networks equipped with the attention mechanism can construct an accurate platform for the prediction of response to the rTMS treatment.https://doi.org/10.1038/s41598-023-35545-2
spellingShingle Mohsen Sadat Shahabi
Ahmad Shalbaf
Reza Rostami
Reza Kazemi
A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
Scientific Reports
title A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
title_full A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
title_fullStr A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
title_full_unstemmed A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
title_short A convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
title_sort convolutional recurrent neural network with attention for response prediction to repetitive transcranial magnetic stimulation in major depressive disorder
url https://doi.org/10.1038/s41598-023-35545-2
work_keys_str_mv AT mohsensadatshahabi aconvolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT ahmadshalbaf aconvolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT rezarostami aconvolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT rezakazemi aconvolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT mohsensadatshahabi convolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT ahmadshalbaf convolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT rezarostami convolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder
AT rezakazemi convolutionalrecurrentneuralnetworkwithattentionforresponsepredictiontorepetitivetranscranialmagneticstimulationinmajordepressivedisorder