The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis

ObjectiveMachine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-a...

Full description

Bibliographic Details
Main Authors: Yanjing Chen, Wei Zhao, Sijie Yi, Jun Liu
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-09-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnins.2023.1174080/full
_version_ 1797677644834144256
author Yanjing Chen
Wei Zhao
Wei Zhao
Sijie Yi
Jun Liu
Jun Liu
author_facet Yanjing Chen
Wei Zhao
Wei Zhao
Sijie Yi
Jun Liu
Jun Liu
author_sort Yanjing Chen
collection DOAJ
description ObjectiveMachine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD.MethodsEnglish databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity.ResultsThirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity.ConclusionML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings.
first_indexed 2024-03-11T22:48:15Z
format Article
id doaj.art-df7d76a01f3841c1a44a140fb771a390
institution Directory Open Access Journal
issn 1662-453X
language English
last_indexed 2024-03-11T22:48:15Z
publishDate 2023-09-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Neuroscience
spelling doaj.art-df7d76a01f3841c1a44a140fb771a3902023-09-22T07:53:48ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2023-09-011710.3389/fnins.2023.11740801174080The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysisYanjing Chen0Wei Zhao1Wei Zhao2Sijie Yi3Jun Liu4Jun Liu5Department of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaDepartment of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaClinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan, ChinaDepartment of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaDepartment of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaClinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan, ChinaObjectiveMachine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD.MethodsEnglish databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity.ResultsThirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity.ConclusionML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings.https://www.frontiersin.org/articles/10.3389/fnins.2023.1174080/fulldepressionmachine learningfunctional connectivityfunctional MRIsupport vector machine
spellingShingle Yanjing Chen
Wei Zhao
Wei Zhao
Sijie Yi
Jun Liu
Jun Liu
The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
Frontiers in Neuroscience
depression
machine learning
functional connectivity
functional MRI
support vector machine
title The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
title_full The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
title_fullStr The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
title_full_unstemmed The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
title_short The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
title_sort diagnostic performance of machine learning based on resting state functional magnetic resonance imaging data for major depressive disorders a systematic review and meta analysis
topic depression
machine learning
functional connectivity
functional MRI
support vector machine
url https://www.frontiersin.org/articles/10.3389/fnins.2023.1174080/full
work_keys_str_mv AT yanjingchen thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT weizhao thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT weizhao thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT sijieyi thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT junliu thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT junliu thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT yanjingchen diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT weizhao diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT weizhao diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT sijieyi diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT junliu diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis
AT junliu diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis