The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis
ObjectiveMachine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-a...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2023-09-01
|
Series: | Frontiers in Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/fnins.2023.1174080/full |
_version_ | 1797677644834144256 |
---|---|
author | Yanjing Chen Wei Zhao Wei Zhao Sijie Yi Jun Liu Jun Liu |
author_facet | Yanjing Chen Wei Zhao Wei Zhao Sijie Yi Jun Liu Jun Liu |
author_sort | Yanjing Chen |
collection | DOAJ |
description | ObjectiveMachine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD.MethodsEnglish databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity.ResultsThirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity.ConclusionML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings. |
first_indexed | 2024-03-11T22:48:15Z |
format | Article |
id | doaj.art-df7d76a01f3841c1a44a140fb771a390 |
institution | Directory Open Access Journal |
issn | 1662-453X |
language | English |
last_indexed | 2024-03-11T22:48:15Z |
publishDate | 2023-09-01 |
publisher | Frontiers Media S.A. |
record_format | Article |
series | Frontiers in Neuroscience |
spelling | doaj.art-df7d76a01f3841c1a44a140fb771a3902023-09-22T07:53:48ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2023-09-011710.3389/fnins.2023.11740801174080The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysisYanjing Chen0Wei Zhao1Wei Zhao2Sijie Yi3Jun Liu4Jun Liu5Department of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaDepartment of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaClinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan, ChinaDepartment of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaDepartment of Radiology, Second Xiangya Hospital, Central South University, Changsha, Hunan, ChinaClinical Research Center for Medical Imaging in Hunan Province, Changsha, Hunan, ChinaObjectiveMachine learning (ML) has been widely used to detect and evaluate major depressive disorder (MDD) using neuroimaging data, i.e., resting-state functional magnetic resonance imaging (rs-fMRI). However, the diagnostic efficiency is unknown. The aim of the study is to conduct an updated meta-analysis to evaluate the diagnostic performance of ML based on rs-fMRI data for MDD.MethodsEnglish databases were searched for relevant studies. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) was used to assess the methodological quality of the included studies. A random-effects meta-analytic model was implemented to investigate the diagnostic efficiency, including sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Regression meta-analysis and subgroup analysis were performed to investigate the cause of heterogeneity.ResultsThirty-one studies were included in this meta-analysis. The pooled sensitivity, specificity, DOR, and AUC with 95% confidence intervals were 0.80 (0.75, 0.83), 0.83 (0.74, 0.82), 14.00 (9, 22.00), and 0.86 (0.83, 0.89), respectively. Substantial heterogeneity was observed among the studies included. The meta-regression showed that the leave-one-out cross-validation (loocv) (sensitivity: p < 0.01, specificity: p < 0.001), graph theory (sensitivity: p < 0.05, specificity: p < 0.01), n > 100 (sensitivity: p < 0.001, specificity: p < 0.001), simens equipment (sensitivity: p < 0.01, specificity: p < 0.001), 3.0T field strength (Sensitivity: p < 0.001, specificity: p = 0.04), and Beck Depression Inventory (BDI) (sensitivity: p = 0.04, specificity: p = 0.06) might be the sources of heterogeneity. Furthermore, the subgroup analysis showed that the sample size (n > 100: sensitivity: 0.71, specificity: 0.72, n < 100: sensitivity: 0.81, specificity: 0.79), the different levels of disease evaluated by the Hamilton Depression Rating Scale (HDRS/HAMD) (mild vs. moderate vs. severe: sensitivity: 0.52 vs. 0.86 vs. 0.89, specificity: 0.62 vs. 0.78 vs. 0.82, respectively), the depression scales in patients with comparable levels of severity. (BDI vs. HDRS/HAMD: sensitivity: 0.86 vs. 0.87, specificity: 0.78 vs. 0.80, respectively), and the features (graph vs. functional connectivity: sensitivity: 0.84 vs. 0.86, specificity: 0.76 vs. 0.78, respectively) selected might be the causes of heterogeneity.ConclusionML showed high accuracy for the automatic diagnosis of MDD. Future studies are warranted to promote the potential use of these classification algorithms in clinical settings.https://www.frontiersin.org/articles/10.3389/fnins.2023.1174080/fulldepressionmachine learningfunctional connectivityfunctional MRIsupport vector machine |
spellingShingle | Yanjing Chen Wei Zhao Wei Zhao Sijie Yi Jun Liu Jun Liu The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis Frontiers in Neuroscience depression machine learning functional connectivity functional MRI support vector machine |
title | The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis |
title_full | The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis |
title_fullStr | The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis |
title_full_unstemmed | The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis |
title_short | The diagnostic performance of machine learning based on resting-state functional magnetic resonance imaging data for major depressive disorders: a systematic review and meta-analysis |
title_sort | diagnostic performance of machine learning based on resting state functional magnetic resonance imaging data for major depressive disorders a systematic review and meta analysis |
topic | depression machine learning functional connectivity functional MRI support vector machine |
url | https://www.frontiersin.org/articles/10.3389/fnins.2023.1174080/full |
work_keys_str_mv | AT yanjingchen thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT weizhao thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT weizhao thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT sijieyi thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT junliu thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT junliu thediagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT yanjingchen diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT weizhao diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT weizhao diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT sijieyi diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT junliu diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis AT junliu diagnosticperformanceofmachinelearningbasedonrestingstatefunctionalmagneticresonanceimagingdataformajordepressivedisordersasystematicreviewandmetaanalysis |