Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study

Abstract Objectives The aim of this study was to investigate the generalization performance of deep learning segmentation models on a large cohort intravascular ultrasound (IVUS) image dataset over the lumen and external elastic membrane (EEM), and to assess the consistency and accuracy of automated...

Full description

Bibliographic Details
Main Authors: Liang Dong, Wei Lu, Xuzhou Lu, Xiaochang Leng, Jianping Xiang, Changling Li
Format: Article
Language:English
Published: BMC 2023-11-01
Series:BioMedical Engineering OnLine
Subjects:
Online Access:https://doi.org/10.1186/s12938-023-01171-2
_version_ 1797414485973008384
author Liang Dong
Wei Lu
Xuzhou Lu
Xiaochang Leng
Jianping Xiang
Changling Li
author_facet Liang Dong
Wei Lu
Xuzhou Lu
Xiaochang Leng
Jianping Xiang
Changling Li
author_sort Liang Dong
collection DOAJ
description Abstract Objectives The aim of this study was to investigate the generalization performance of deep learning segmentation models on a large cohort intravascular ultrasound (IVUS) image dataset over the lumen and external elastic membrane (EEM), and to assess the consistency and accuracy of automated IVUS quantitative measurement parameters. Methods A total of 11,070 IVUS images from 113 patients and pullbacks were collected and annotated by cardiologists to train and test deep learning segmentation models. A comparison of five state of the art medical image segmentation models was performed by evaluating the segmentation of the lumen and EEM. Dice similarity coefficient (DSC), intersection over union (IoU) and Hausdorff distance (HD) were calculated for the overall and for subsets of different IVUS image categories. Further, the agreement between the IVUS quantitative measurement parameters calculated by automatic segmentation and those calculated by manual segmentation was evaluated. Finally, the segmentation performance of our model was also compared with previous studies. Results CENet achieved the best performance in DSC (0.958 for lumen, 0.921 for EEM) and IoU (0.975 for lumen, 0.951 for EEM) among all models, while Res-UNet was the best performer in HD (0.219 for lumen, 0.178 for EEM). The mean intraclass correlation coefficient (ICC) and Bland–Altman plot demonstrated the extremely strong agreement (0.855, 95% CI 0.822–0.887) between model's automatic prediction and manual measurements. Conclusions Deep learning models based on large cohort image datasets were capable of achieving state of the art (SOTA) results in lumen and EEM segmentation. It can be used for IVUS clinical evaluation and achieve excellent agreement with clinicians on quantitative parameter measurements.
first_indexed 2024-03-09T05:33:57Z
format Article
id doaj.art-e991f4d3d67c4019bc4432f7729a49ec
institution Directory Open Access Journal
issn 1475-925X
language English
last_indexed 2024-03-09T05:33:57Z
publishDate 2023-11-01
publisher BMC
record_format Article
series BioMedical Engineering OnLine
spelling doaj.art-e991f4d3d67c4019bc4432f7729a49ec2023-12-03T12:30:54ZengBMCBioMedical Engineering OnLine1475-925X2023-11-0122111410.1186/s12938-023-01171-2Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort studyLiang Dong0Wei Lu1Xuzhou Lu2Xiaochang Leng3Jianping Xiang4Changling Li5The Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of MedicineArteryFlow Technology Co., LtdArteryFlow Technology Co., LtdArteryFlow Technology Co., LtdArteryFlow Technology Co., LtdThe Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of MedicineAbstract Objectives The aim of this study was to investigate the generalization performance of deep learning segmentation models on a large cohort intravascular ultrasound (IVUS) image dataset over the lumen and external elastic membrane (EEM), and to assess the consistency and accuracy of automated IVUS quantitative measurement parameters. Methods A total of 11,070 IVUS images from 113 patients and pullbacks were collected and annotated by cardiologists to train and test deep learning segmentation models. A comparison of five state of the art medical image segmentation models was performed by evaluating the segmentation of the lumen and EEM. Dice similarity coefficient (DSC), intersection over union (IoU) and Hausdorff distance (HD) were calculated for the overall and for subsets of different IVUS image categories. Further, the agreement between the IVUS quantitative measurement parameters calculated by automatic segmentation and those calculated by manual segmentation was evaluated. Finally, the segmentation performance of our model was also compared with previous studies. Results CENet achieved the best performance in DSC (0.958 for lumen, 0.921 for EEM) and IoU (0.975 for lumen, 0.951 for EEM) among all models, while Res-UNet was the best performer in HD (0.219 for lumen, 0.178 for EEM). The mean intraclass correlation coefficient (ICC) and Bland–Altman plot demonstrated the extremely strong agreement (0.855, 95% CI 0.822–0.887) between model's automatic prediction and manual measurements. Conclusions Deep learning models based on large cohort image datasets were capable of achieving state of the art (SOTA) results in lumen and EEM segmentation. It can be used for IVUS clinical evaluation and achieve excellent agreement with clinicians on quantitative parameter measurements.https://doi.org/10.1186/s12938-023-01171-2Intravascular ultrasoundDeep learningImage segmentationCalcified plaque
spellingShingle Liang Dong
Wei Lu
Xuzhou Lu
Xiaochang Leng
Jianping Xiang
Changling Li
Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
BioMedical Engineering OnLine
Intravascular ultrasound
Deep learning
Image segmentation
Calcified plaque
title Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
title_full Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
title_fullStr Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
title_full_unstemmed Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
title_short Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
title_sort comparison of deep learning based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
topic Intravascular ultrasound
Deep learning
Image segmentation
Calcified plaque
url https://doi.org/10.1186/s12938-023-01171-2
work_keys_str_mv AT liangdong comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy
AT weilu comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy
AT xuzhoulu comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy
AT xiaochangleng comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy
AT jianpingxiang comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy
AT changlingli comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy