Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair

Objective: The objective of this study was to develop a machine deep learning algorithm for endoleak detection and measurement of aneurysm diameter, area, and volume from computed tomography angiography (CTA). Methods: Digital Imaging and Communications in Medicine files representing three-phase pos...

Full description

Bibliographic Details
Main Authors: Sage Hahn, BA, Mark Perry, MD, Christopher S. Morris, MD, Safwan Wshah, PhD, Daniel J. Bertges, MD
Format: Article
Language:English
Published: Elsevier 2020-01-01
Series:JVS - Vascular Science
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666350319300045
_version_ 1818642663366197248
author Sage Hahn, BA
Mark Perry, MD
Christopher S. Morris, MD
Safwan Wshah, PhD
Daniel J. Bertges, MD
author_facet Sage Hahn, BA
Mark Perry, MD
Christopher S. Morris, MD
Safwan Wshah, PhD
Daniel J. Bertges, MD
author_sort Sage Hahn, BA
collection DOAJ
description Objective: The objective of this study was to develop a machine deep learning algorithm for endoleak detection and measurement of aneurysm diameter, area, and volume from computed tomography angiography (CTA). Methods: Digital Imaging and Communications in Medicine files representing three-phase postoperative CTA images (N = 334) of 191 unique patients undergoing endovascular aneurysm repair for infrarenal abdominal aortic aneurysm (AAA) with a variety of commercial devices were used to train a deep learning pipeline across four tasks. The RetinaNet object-detection convolutional neural network (CNN) architecture was trained to predict bounding boxes around the axial CTA slices that were then stitched together in two dimensions into a smaller region containing the aneurysm. Multiclass endoleak detection and segmentation of the AAA, endograft, and endoleak were performed on this smaller region. Segmentations on a single randomly selected contrast from each scan included 33 full and 68 partial segmentations for endograft and AAA and 99 full segmentations for endoleak. A modified version of ResNet-50 CNN was used to detect endoleak on individual axial slices. A three-dimensional U-Net CNN model was trained on the task of dense three-dimensional segmentation and used to measure diameter and volume with a specially designed loss function. We made use of fivefold cross-validation to evaluate model performance for each step, splitting training and testing data at each fold, such that multiple scans from the same patient were preserved with the same fold. Algorithm predictions for endoleak were compared with the radiology report and with a subset of CTA images independently read by two vascular specialists. Results: The localization portion of the network accurately predicted a region of interest containing the AAA in 99% of cases. The best model of binary endoleak detection obtained an area under the receiver operating characteristic curve of 0.94 ± 0.03 with an optimized accuracy of 0.89 ± 0.03 on a balanced data set. An introduced postprocessing algorithm for determining maximum diameter was used on both the predicted AAA segmentation and ground truth segmentation, predicting on average an absolute diameter error of 2.3 ± 2.0 mm by 1.4 ± 1.7 mm for each measurement, respectively. The algorithm measured AAA and endograft volume accurately (Dice coefficient, 0.95 ± 0.2) with an absolute volume error of 10.1 ± 9.1 mL. The algorithm measured endoleak volume less accurately, with a Dice score of 0.53 ± 0.21 and an average absolute volume error of 1.2 ± 1.9 mL. Conclusions: This machine learning algorithm shows promise in augmenting a human's ability to interpret postoperative CTA images and may help improve surveillance after endovascular aneurysm repair. External validation on larger data sets and prospective study are required before the algorithm can be clinically applicable. : Clinical Relevance: This manuscript describing the application of machine learning for endoleak has clinical relevance to endovascular abdominal aortic aneurysm follow-up. The techniques described herein may be more broadly applied to the diagnosis of aortic disease. In the future, vascular surgeons will benefit from integrating such artificial intelligence algorithms into their practice.
first_indexed 2024-12-16T23:46:38Z
format Article
id doaj.art-3768ee6bba714ea6b0890af7a4300bcc
institution Directory Open Access Journal
issn 2666-3503
language English
last_indexed 2024-12-16T23:46:38Z
publishDate 2020-01-01
publisher Elsevier
record_format Article
series JVS - Vascular Science
spelling doaj.art-3768ee6bba714ea6b0890af7a4300bcc2022-12-21T22:11:29ZengElsevierJVS - Vascular Science2666-35032020-01-011512Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repairSage Hahn, BA0Mark Perry, MD1Christopher S. Morris, MD2Safwan Wshah, PhD3Daniel J. Bertges, MD4Department of Complex Systems, University of Vermont, Burlington, VtDivision of Vascular Surgery, University of Vermont Medical Center, Burlington, VtDepartment of Radiology, University of Vermont Medical Center, Burlington, VtDepartment of Computer Science, University of Vermont, Burlington, VtDivision of Vascular Surgery, University of Vermont Medical Center, Burlington, Vt; Correspondence: Daniel J. Bertges, MD, Associate Professor of Surgery and Medicine, University of Vermont Medical Center, Division of Vascular Surgery, 111 Colchester Ave, Smith 338, Burlington, VT 05401Objective: The objective of this study was to develop a machine deep learning algorithm for endoleak detection and measurement of aneurysm diameter, area, and volume from computed tomography angiography (CTA). Methods: Digital Imaging and Communications in Medicine files representing three-phase postoperative CTA images (N = 334) of 191 unique patients undergoing endovascular aneurysm repair for infrarenal abdominal aortic aneurysm (AAA) with a variety of commercial devices were used to train a deep learning pipeline across four tasks. The RetinaNet object-detection convolutional neural network (CNN) architecture was trained to predict bounding boxes around the axial CTA slices that were then stitched together in two dimensions into a smaller region containing the aneurysm. Multiclass endoleak detection and segmentation of the AAA, endograft, and endoleak were performed on this smaller region. Segmentations on a single randomly selected contrast from each scan included 33 full and 68 partial segmentations for endograft and AAA and 99 full segmentations for endoleak. A modified version of ResNet-50 CNN was used to detect endoleak on individual axial slices. A three-dimensional U-Net CNN model was trained on the task of dense three-dimensional segmentation and used to measure diameter and volume with a specially designed loss function. We made use of fivefold cross-validation to evaluate model performance for each step, splitting training and testing data at each fold, such that multiple scans from the same patient were preserved with the same fold. Algorithm predictions for endoleak were compared with the radiology report and with a subset of CTA images independently read by two vascular specialists. Results: The localization portion of the network accurately predicted a region of interest containing the AAA in 99% of cases. The best model of binary endoleak detection obtained an area under the receiver operating characteristic curve of 0.94 ± 0.03 with an optimized accuracy of 0.89 ± 0.03 on a balanced data set. An introduced postprocessing algorithm for determining maximum diameter was used on both the predicted AAA segmentation and ground truth segmentation, predicting on average an absolute diameter error of 2.3 ± 2.0 mm by 1.4 ± 1.7 mm for each measurement, respectively. The algorithm measured AAA and endograft volume accurately (Dice coefficient, 0.95 ± 0.2) with an absolute volume error of 10.1 ± 9.1 mL. The algorithm measured endoleak volume less accurately, with a Dice score of 0.53 ± 0.21 and an average absolute volume error of 1.2 ± 1.9 mL. Conclusions: This machine learning algorithm shows promise in augmenting a human's ability to interpret postoperative CTA images and may help improve surveillance after endovascular aneurysm repair. External validation on larger data sets and prospective study are required before the algorithm can be clinically applicable. : Clinical Relevance: This manuscript describing the application of machine learning for endoleak has clinical relevance to endovascular abdominal aortic aneurysm follow-up. The techniques described herein may be more broadly applied to the diagnosis of aortic disease. In the future, vascular surgeons will benefit from integrating such artificial intelligence algorithms into their practice.http://www.sciencedirect.com/science/article/pii/S2666350319300045Machine learningDeep learningEndoleakAbdominal aortic aneurysm
spellingShingle Sage Hahn, BA
Mark Perry, MD
Christopher S. Morris, MD
Safwan Wshah, PhD
Daniel J. Bertges, MD
Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
JVS - Vascular Science
Machine learning
Deep learning
Endoleak
Abdominal aortic aneurysm
title Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
title_full Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
title_fullStr Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
title_full_unstemmed Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
title_short Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
title_sort machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
topic Machine learning
Deep learning
Endoleak
Abdominal aortic aneurysm
url http://www.sciencedirect.com/science/article/pii/S2666350319300045
work_keys_str_mv AT sagehahnba machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair
AT markperrymd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair
AT christophersmorrismd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair
AT safwanwshahphd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair
AT danieljbertgesmd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair