Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study
Abstract Objectives The aim of this study was to investigate the generalization performance of deep learning segmentation models on a large cohort intravascular ultrasound (IVUS) image dataset over the lumen and external elastic membrane (EEM), and to assess the consistency and accuracy of automated...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2023-11-01
|
Series: | BioMedical Engineering OnLine |
Subjects: | |
Online Access: | https://doi.org/10.1186/s12938-023-01171-2 |
_version_ | 1797414485973008384 |
---|---|
author | Liang Dong Wei Lu Xuzhou Lu Xiaochang Leng Jianping Xiang Changling Li |
author_facet | Liang Dong Wei Lu Xuzhou Lu Xiaochang Leng Jianping Xiang Changling Li |
author_sort | Liang Dong |
collection | DOAJ |
description | Abstract Objectives The aim of this study was to investigate the generalization performance of deep learning segmentation models on a large cohort intravascular ultrasound (IVUS) image dataset over the lumen and external elastic membrane (EEM), and to assess the consistency and accuracy of automated IVUS quantitative measurement parameters. Methods A total of 11,070 IVUS images from 113 patients and pullbacks were collected and annotated by cardiologists to train and test deep learning segmentation models. A comparison of five state of the art medical image segmentation models was performed by evaluating the segmentation of the lumen and EEM. Dice similarity coefficient (DSC), intersection over union (IoU) and Hausdorff distance (HD) were calculated for the overall and for subsets of different IVUS image categories. Further, the agreement between the IVUS quantitative measurement parameters calculated by automatic segmentation and those calculated by manual segmentation was evaluated. Finally, the segmentation performance of our model was also compared with previous studies. Results CENet achieved the best performance in DSC (0.958 for lumen, 0.921 for EEM) and IoU (0.975 for lumen, 0.951 for EEM) among all models, while Res-UNet was the best performer in HD (0.219 for lumen, 0.178 for EEM). The mean intraclass correlation coefficient (ICC) and Bland–Altman plot demonstrated the extremely strong agreement (0.855, 95% CI 0.822–0.887) between model's automatic prediction and manual measurements. Conclusions Deep learning models based on large cohort image datasets were capable of achieving state of the art (SOTA) results in lumen and EEM segmentation. It can be used for IVUS clinical evaluation and achieve excellent agreement with clinicians on quantitative parameter measurements. |
first_indexed | 2024-03-09T05:33:57Z |
format | Article |
id | doaj.art-e991f4d3d67c4019bc4432f7729a49ec |
institution | Directory Open Access Journal |
issn | 1475-925X |
language | English |
last_indexed | 2024-03-09T05:33:57Z |
publishDate | 2023-11-01 |
publisher | BMC |
record_format | Article |
series | BioMedical Engineering OnLine |
spelling | doaj.art-e991f4d3d67c4019bc4432f7729a49ec2023-12-03T12:30:54ZengBMCBioMedical Engineering OnLine1475-925X2023-11-0122111410.1186/s12938-023-01171-2Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort studyLiang Dong0Wei Lu1Xuzhou Lu2Xiaochang Leng3Jianping Xiang4Changling Li5The Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of MedicineArteryFlow Technology Co., LtdArteryFlow Technology Co., LtdArteryFlow Technology Co., LtdArteryFlow Technology Co., LtdThe Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of MedicineAbstract Objectives The aim of this study was to investigate the generalization performance of deep learning segmentation models on a large cohort intravascular ultrasound (IVUS) image dataset over the lumen and external elastic membrane (EEM), and to assess the consistency and accuracy of automated IVUS quantitative measurement parameters. Methods A total of 11,070 IVUS images from 113 patients and pullbacks were collected and annotated by cardiologists to train and test deep learning segmentation models. A comparison of five state of the art medical image segmentation models was performed by evaluating the segmentation of the lumen and EEM. Dice similarity coefficient (DSC), intersection over union (IoU) and Hausdorff distance (HD) were calculated for the overall and for subsets of different IVUS image categories. Further, the agreement between the IVUS quantitative measurement parameters calculated by automatic segmentation and those calculated by manual segmentation was evaluated. Finally, the segmentation performance of our model was also compared with previous studies. Results CENet achieved the best performance in DSC (0.958 for lumen, 0.921 for EEM) and IoU (0.975 for lumen, 0.951 for EEM) among all models, while Res-UNet was the best performer in HD (0.219 for lumen, 0.178 for EEM). The mean intraclass correlation coefficient (ICC) and Bland–Altman plot demonstrated the extremely strong agreement (0.855, 95% CI 0.822–0.887) between model's automatic prediction and manual measurements. Conclusions Deep learning models based on large cohort image datasets were capable of achieving state of the art (SOTA) results in lumen and EEM segmentation. It can be used for IVUS clinical evaluation and achieve excellent agreement with clinicians on quantitative parameter measurements.https://doi.org/10.1186/s12938-023-01171-2Intravascular ultrasoundDeep learningImage segmentationCalcified plaque |
spellingShingle | Liang Dong Wei Lu Xuzhou Lu Xiaochang Leng Jianping Xiang Changling Li Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study BioMedical Engineering OnLine Intravascular ultrasound Deep learning Image segmentation Calcified plaque |
title | Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study |
title_full | Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study |
title_fullStr | Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study |
title_full_unstemmed | Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study |
title_short | Comparison of deep learning-based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study |
title_sort | comparison of deep learning based image segmentation methods for intravascular ultrasound on retrospective and large image cohort study |
topic | Intravascular ultrasound Deep learning Image segmentation Calcified plaque |
url | https://doi.org/10.1186/s12938-023-01171-2 |
work_keys_str_mv | AT liangdong comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy AT weilu comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy AT xuzhoulu comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy AT xiaochangleng comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy AT jianpingxiang comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy AT changlingli comparisonofdeeplearningbasedimagesegmentationmethodsforintravascularultrasoundonretrospectiveandlargeimagecohortstudy |