Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images

Abstract Background The severity assessment of lumbar disc herniation (LDH) on MR images is crucial for selecting suitable surgical candidates. However, the interpretation of MR images is time‐consuming and requires repetitive work. This study aims to develop and evaluate a deep learning‐based diagn...

Full description

Bibliographic Details
Main Authors: Weicong Zhang, Ziyang Chen, Zhihai Su, Zhengyan Wang, Jinjin Hai, Chengjie Huang, Yuhan Wang, Bin Yan, Hai Lu
Format: Article
Language:English
Published: Wiley 2023-09-01
Series:JOR Spine
Subjects:
Online Access:https://doi.org/10.1002/jsp2.1276
_version_ 1797670757590892544
author Weicong Zhang
Ziyang Chen
Zhihai Su
Zhengyan Wang
Jinjin Hai
Chengjie Huang
Yuhan Wang
Bin Yan
Hai Lu
author_facet Weicong Zhang
Ziyang Chen
Zhihai Su
Zhengyan Wang
Jinjin Hai
Chengjie Huang
Yuhan Wang
Bin Yan
Hai Lu
author_sort Weicong Zhang
collection DOAJ
description Abstract Background The severity assessment of lumbar disc herniation (LDH) on MR images is crucial for selecting suitable surgical candidates. However, the interpretation of MR images is time‐consuming and requires repetitive work. This study aims to develop and evaluate a deep learning‐based diagnostic model for automated LDH detection and classification on lumbar axial T2‐weighted MR images. Methods A total of 1115 patients were analyzed in this retrospective study; both a development dataset (1015 patients, 15 249 images) and an external test dataset (100 patients, 1273 images) were utilized. According to the Michigan State University (MSU) classification criterion, experts labeled all images with consensus, and the final labeled results were regarded as the reference standard. The automated diagnostic model comprised Faster R‐CNN and ResNeXt101 as the detection and classification network, respectively. The deep learning‐based diagnostic performance was evaluated by calculating mean intersection over union (IoU), accuracy, precision, sensitivity, specificity, F1 score, the area under the receiver operating characteristics curve (AUC), and intraclass correlation coefficient (ICC) with 95% confidence intervals (CIs). Results High detection consistency was obtained in the internal test dataset (mean IoU = 0.82, precision = 98.4%, sensitivity = 99.4%) and external test dataset (mean IoU = 0.70, precision = 96.3%, sensitivity = 97.8%). Overall accuracy for LDH classification was 87.70% (95% CI: 86.59%–88.86%) and 74.23% (95% CI: 71.83%–76.75%) in the internal and external test datasets, respectively. For internal testing, the proposed model achieved a high agreement in classification (ICC = 0.87, 95% CI: 0.86–0.88, P < 0.001), which was higher than that of external testing (ICC = 0.79, 95% CI: 0.76–0.81, P < 0.001). The AUC for model classification was 0.965 (95% CI: 0.962–0.968) and 0.916 (95% CI: 0.908–0.925) in the internal and external test datasets, respectively. Conclusions The automated diagnostic model achieved high performance in detecting and classifying LDH and exhibited considerable consistency with experts' classification.
first_indexed 2024-03-11T21:05:10Z
format Article
id doaj.art-fe64d682cca4455686160688ab70ac2e
institution Directory Open Access Journal
issn 2572-1143
language English
last_indexed 2024-03-11T21:05:10Z
publishDate 2023-09-01
publisher Wiley
record_format Article
series JOR Spine
spelling doaj.art-fe64d682cca4455686160688ab70ac2e2023-09-29T14:33:35ZengWileyJOR Spine2572-11432023-09-0163n/an/a10.1002/jsp2.1276Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance imagesWeicong Zhang0Ziyang Chen1Zhihai Su2Zhengyan Wang3Jinjin Hai4Chengjie Huang5Yuhan Wang6Bin Yan7Hai Lu8Department of Spinal Surgery The Fifth Affiliated Hospital of Sun Yat‐sen University Zhuhai Guangdong ChinaDepartment of Spinal Surgery The Fifth Affiliated Hospital of Sun Yat‐sen University Zhuhai Guangdong ChinaDepartment of Spinal Surgery The Fifth Affiliated Hospital of Sun Yat‐sen University Zhuhai Guangdong ChinaHenan Key Laboratory of Imaging and Intelligent Processing PLA Strategic Support Force Information Engineering University Zhengzhou ChinaHenan Key Laboratory of Imaging and Intelligent Processing PLA Strategic Support Force Information Engineering University Zhengzhou ChinaDepartment of Spinal Surgery The Fifth Affiliated Hospital of Sun Yat‐sen University Zhuhai Guangdong ChinaDepartment of Spinal Surgery The Fifth Affiliated Hospital of Sun Yat‐sen University Zhuhai Guangdong ChinaHenan Key Laboratory of Imaging and Intelligent Processing PLA Strategic Support Force Information Engineering University Zhengzhou ChinaDepartment of Spinal Surgery The Fifth Affiliated Hospital of Sun Yat‐sen University Zhuhai Guangdong ChinaAbstract Background The severity assessment of lumbar disc herniation (LDH) on MR images is crucial for selecting suitable surgical candidates. However, the interpretation of MR images is time‐consuming and requires repetitive work. This study aims to develop and evaluate a deep learning‐based diagnostic model for automated LDH detection and classification on lumbar axial T2‐weighted MR images. Methods A total of 1115 patients were analyzed in this retrospective study; both a development dataset (1015 patients, 15 249 images) and an external test dataset (100 patients, 1273 images) were utilized. According to the Michigan State University (MSU) classification criterion, experts labeled all images with consensus, and the final labeled results were regarded as the reference standard. The automated diagnostic model comprised Faster R‐CNN and ResNeXt101 as the detection and classification network, respectively. The deep learning‐based diagnostic performance was evaluated by calculating mean intersection over union (IoU), accuracy, precision, sensitivity, specificity, F1 score, the area under the receiver operating characteristics curve (AUC), and intraclass correlation coefficient (ICC) with 95% confidence intervals (CIs). Results High detection consistency was obtained in the internal test dataset (mean IoU = 0.82, precision = 98.4%, sensitivity = 99.4%) and external test dataset (mean IoU = 0.70, precision = 96.3%, sensitivity = 97.8%). Overall accuracy for LDH classification was 87.70% (95% CI: 86.59%–88.86%) and 74.23% (95% CI: 71.83%–76.75%) in the internal and external test datasets, respectively. For internal testing, the proposed model achieved a high agreement in classification (ICC = 0.87, 95% CI: 0.86–0.88, P < 0.001), which was higher than that of external testing (ICC = 0.79, 95% CI: 0.76–0.81, P < 0.001). The AUC for model classification was 0.965 (95% CI: 0.962–0.968) and 0.916 (95% CI: 0.908–0.925) in the internal and external test datasets, respectively. Conclusions The automated diagnostic model achieved high performance in detecting and classifying LDH and exhibited considerable consistency with experts' classification.https://doi.org/10.1002/jsp2.1276classificationdeep learningdetectionlumbar disc herniationmagnetic resonance images
spellingShingle Weicong Zhang
Ziyang Chen
Zhihai Su
Zhengyan Wang
Jinjin Hai
Chengjie Huang
Yuhan Wang
Bin Yan
Hai Lu
Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images
JOR Spine
classification
deep learning
detection
lumbar disc herniation
magnetic resonance images
title Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images
title_full Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images
title_fullStr Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images
title_full_unstemmed Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images
title_short Deep learning‐based detection and classification of lumbar disc herniation on magnetic resonance images
title_sort deep learning based detection and classification of lumbar disc herniation on magnetic resonance images
topic classification
deep learning
detection
lumbar disc herniation
magnetic resonance images
url https://doi.org/10.1002/jsp2.1276
work_keys_str_mv AT weicongzhang deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT ziyangchen deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT zhihaisu deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT zhengyanwang deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT jinjinhai deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT chengjiehuang deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT yuhanwang deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT binyan deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages
AT hailu deeplearningbaseddetectionandclassificationoflumbardischerniationonmagneticresonanceimages