Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair
Objective: The objective of this study was to develop a machine deep learning algorithm for endoleak detection and measurement of aneurysm diameter, area, and volume from computed tomography angiography (CTA). Methods: Digital Imaging and Communications in Medicine files representing three-phase pos...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2020-01-01
|
Series: | JVS - Vascular Science |
Subjects: | |
Online Access: | http://www.sciencedirect.com/science/article/pii/S2666350319300045 |
_version_ | 1818642663366197248 |
---|---|
author | Sage Hahn, BA Mark Perry, MD Christopher S. Morris, MD Safwan Wshah, PhD Daniel J. Bertges, MD |
author_facet | Sage Hahn, BA Mark Perry, MD Christopher S. Morris, MD Safwan Wshah, PhD Daniel J. Bertges, MD |
author_sort | Sage Hahn, BA |
collection | DOAJ |
description | Objective: The objective of this study was to develop a machine deep learning algorithm for endoleak detection and measurement of aneurysm diameter, area, and volume from computed tomography angiography (CTA). Methods: Digital Imaging and Communications in Medicine files representing three-phase postoperative CTA images (N = 334) of 191 unique patients undergoing endovascular aneurysm repair for infrarenal abdominal aortic aneurysm (AAA) with a variety of commercial devices were used to train a deep learning pipeline across four tasks. The RetinaNet object-detection convolutional neural network (CNN) architecture was trained to predict bounding boxes around the axial CTA slices that were then stitched together in two dimensions into a smaller region containing the aneurysm. Multiclass endoleak detection and segmentation of the AAA, endograft, and endoleak were performed on this smaller region. Segmentations on a single randomly selected contrast from each scan included 33 full and 68 partial segmentations for endograft and AAA and 99 full segmentations for endoleak. A modified version of ResNet-50 CNN was used to detect endoleak on individual axial slices. A three-dimensional U-Net CNN model was trained on the task of dense three-dimensional segmentation and used to measure diameter and volume with a specially designed loss function. We made use of fivefold cross-validation to evaluate model performance for each step, splitting training and testing data at each fold, such that multiple scans from the same patient were preserved with the same fold. Algorithm predictions for endoleak were compared with the radiology report and with a subset of CTA images independently read by two vascular specialists. Results: The localization portion of the network accurately predicted a region of interest containing the AAA in 99% of cases. The best model of binary endoleak detection obtained an area under the receiver operating characteristic curve of 0.94 ± 0.03 with an optimized accuracy of 0.89 ± 0.03 on a balanced data set. An introduced postprocessing algorithm for determining maximum diameter was used on both the predicted AAA segmentation and ground truth segmentation, predicting on average an absolute diameter error of 2.3 ± 2.0 mm by 1.4 ± 1.7 mm for each measurement, respectively. The algorithm measured AAA and endograft volume accurately (Dice coefficient, 0.95 ± 0.2) with an absolute volume error of 10.1 ± 9.1 mL. The algorithm measured endoleak volume less accurately, with a Dice score of 0.53 ± 0.21 and an average absolute volume error of 1.2 ± 1.9 mL. Conclusions: This machine learning algorithm shows promise in augmenting a human's ability to interpret postoperative CTA images and may help improve surveillance after endovascular aneurysm repair. External validation on larger data sets and prospective study are required before the algorithm can be clinically applicable. : Clinical Relevance: This manuscript describing the application of machine learning for endoleak has clinical relevance to endovascular abdominal aortic aneurysm follow-up. The techniques described herein may be more broadly applied to the diagnosis of aortic disease. In the future, vascular surgeons will benefit from integrating such artificial intelligence algorithms into their practice. |
first_indexed | 2024-12-16T23:46:38Z |
format | Article |
id | doaj.art-3768ee6bba714ea6b0890af7a4300bcc |
institution | Directory Open Access Journal |
issn | 2666-3503 |
language | English |
last_indexed | 2024-12-16T23:46:38Z |
publishDate | 2020-01-01 |
publisher | Elsevier |
record_format | Article |
series | JVS - Vascular Science |
spelling | doaj.art-3768ee6bba714ea6b0890af7a4300bcc2022-12-21T22:11:29ZengElsevierJVS - Vascular Science2666-35032020-01-011512Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repairSage Hahn, BA0Mark Perry, MD1Christopher S. Morris, MD2Safwan Wshah, PhD3Daniel J. Bertges, MD4Department of Complex Systems, University of Vermont, Burlington, VtDivision of Vascular Surgery, University of Vermont Medical Center, Burlington, VtDepartment of Radiology, University of Vermont Medical Center, Burlington, VtDepartment of Computer Science, University of Vermont, Burlington, VtDivision of Vascular Surgery, University of Vermont Medical Center, Burlington, Vt; Correspondence: Daniel J. Bertges, MD, Associate Professor of Surgery and Medicine, University of Vermont Medical Center, Division of Vascular Surgery, 111 Colchester Ave, Smith 338, Burlington, VT 05401Objective: The objective of this study was to develop a machine deep learning algorithm for endoleak detection and measurement of aneurysm diameter, area, and volume from computed tomography angiography (CTA). Methods: Digital Imaging and Communications in Medicine files representing three-phase postoperative CTA images (N = 334) of 191 unique patients undergoing endovascular aneurysm repair for infrarenal abdominal aortic aneurysm (AAA) with a variety of commercial devices were used to train a deep learning pipeline across four tasks. The RetinaNet object-detection convolutional neural network (CNN) architecture was trained to predict bounding boxes around the axial CTA slices that were then stitched together in two dimensions into a smaller region containing the aneurysm. Multiclass endoleak detection and segmentation of the AAA, endograft, and endoleak were performed on this smaller region. Segmentations on a single randomly selected contrast from each scan included 33 full and 68 partial segmentations for endograft and AAA and 99 full segmentations for endoleak. A modified version of ResNet-50 CNN was used to detect endoleak on individual axial slices. A three-dimensional U-Net CNN model was trained on the task of dense three-dimensional segmentation and used to measure diameter and volume with a specially designed loss function. We made use of fivefold cross-validation to evaluate model performance for each step, splitting training and testing data at each fold, such that multiple scans from the same patient were preserved with the same fold. Algorithm predictions for endoleak were compared with the radiology report and with a subset of CTA images independently read by two vascular specialists. Results: The localization portion of the network accurately predicted a region of interest containing the AAA in 99% of cases. The best model of binary endoleak detection obtained an area under the receiver operating characteristic curve of 0.94 ± 0.03 with an optimized accuracy of 0.89 ± 0.03 on a balanced data set. An introduced postprocessing algorithm for determining maximum diameter was used on both the predicted AAA segmentation and ground truth segmentation, predicting on average an absolute diameter error of 2.3 ± 2.0 mm by 1.4 ± 1.7 mm for each measurement, respectively. The algorithm measured AAA and endograft volume accurately (Dice coefficient, 0.95 ± 0.2) with an absolute volume error of 10.1 ± 9.1 mL. The algorithm measured endoleak volume less accurately, with a Dice score of 0.53 ± 0.21 and an average absolute volume error of 1.2 ± 1.9 mL. Conclusions: This machine learning algorithm shows promise in augmenting a human's ability to interpret postoperative CTA images and may help improve surveillance after endovascular aneurysm repair. External validation on larger data sets and prospective study are required before the algorithm can be clinically applicable. : Clinical Relevance: This manuscript describing the application of machine learning for endoleak has clinical relevance to endovascular abdominal aortic aneurysm follow-up. The techniques described herein may be more broadly applied to the diagnosis of aortic disease. In the future, vascular surgeons will benefit from integrating such artificial intelligence algorithms into their practice.http://www.sciencedirect.com/science/article/pii/S2666350319300045Machine learningDeep learningEndoleakAbdominal aortic aneurysm |
spellingShingle | Sage Hahn, BA Mark Perry, MD Christopher S. Morris, MD Safwan Wshah, PhD Daniel J. Bertges, MD Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair JVS - Vascular Science Machine learning Deep learning Endoleak Abdominal aortic aneurysm |
title | Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair |
title_full | Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair |
title_fullStr | Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair |
title_full_unstemmed | Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair |
title_short | Machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair |
title_sort | machine deep learning accurately detects endoleak after endovascular abdominal aortic aneurysm repair |
topic | Machine learning Deep learning Endoleak Abdominal aortic aneurysm |
url | http://www.sciencedirect.com/science/article/pii/S2666350319300045 |
work_keys_str_mv | AT sagehahnba machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair AT markperrymd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair AT christophersmorrismd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair AT safwanwshahphd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair AT danieljbertgesmd machinedeeplearningaccuratelydetectsendoleakafterendovascularabdominalaorticaneurysmrepair |