A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images

The integrative analysis of multimodal medical images plays an important role in the diagnosis of coronary artery disease by providing additional comprehensive information that cannot be found in an individual source image. Intravascular ultrasound (IVUS) and optical coherence tomography (IV-OCT) ar...

Full description

Bibliographic Details
Main Authors: Chenxi Huang, Yuan Xie, Yisha Lan, Yongtao Hao, Fei Chen, Yongqiang Cheng, Yonghong Peng
Format: Article
Language:English
Published: IEEE 2018-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8362608/
_version_ 1818331772815933440
author Chenxi Huang
Yuan Xie
Yisha Lan
Yongtao Hao
Fei Chen
Yongqiang Cheng
Yonghong Peng
author_facet Chenxi Huang
Yuan Xie
Yisha Lan
Yongtao Hao
Fei Chen
Yongqiang Cheng
Yonghong Peng
author_sort Chenxi Huang
collection DOAJ
description The integrative analysis of multimodal medical images plays an important role in the diagnosis of coronary artery disease by providing additional comprehensive information that cannot be found in an individual source image. Intravascular ultrasound (IVUS) and optical coherence tomography (IV-OCT) are two imaging modalities that have been widely used in the medical practice for the assessment of arterial health and the detection of vascular lumen lesions. IV-OCT has a high resolution and poor penetration, while IVUS has a low resolution and high detection depth. This paper proposes a new approach for the fusion of intravascular ultrasound and optical coherence tomography pullbacks to significantly improve the use of those two types of medical images. It also presents a new two-phase multimodal fusion framework using a coarse-to-fine registration and a wavelet fusion method. In the coarse-registration process, we define a set of new feature points to match the IVUS image and IV-OCT image. Then, the improved quality image is obtained based on the integration of the mutual information of two types of images. Finally, the matched registered images are fused with an approach based on the new proposed wavelet algorithm. The experimental results demonstrate the performance of the proposed new approach for significantly enhancing both the precision and computational stability. The proposed approach is shown to be promising for providing additional information to enhance the diagnosis and enable a deeper understanding of atherosclerosis.
first_indexed 2024-12-13T13:25:10Z
format Article
id doaj.art-7d3be85f406643adae8011cf7ee64864
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-13T13:25:10Z
publishDate 2018-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-7d3be85f406643adae8011cf7ee648642022-12-21T23:44:19ZengIEEEIEEE Access2169-35362018-01-016364083641910.1109/ACCESS.2018.28396948362608A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography ImagesChenxi Huang0Yuan Xie1Yisha Lan2Yongtao Hao3Fei Chen4Yongqiang Cheng5https://orcid.org/0000-0001-7282-7638Yonghong Peng6Department of Computer Science and Technology, Tongji University, Shanghai, ChinaDepartment of Computer Science and Technology, Tongji University, Shanghai, ChinaDepartment of Computer Science and Technology, Tongji University, Shanghai, ChinaDepartment of Computer Science and Technology, Tongji University, Shanghai, ChinaDepartment of Cardiology, Shanghai Tongji Hospital, Tongji University, Shanghai, ChinaSchool of Engineering and Computer Science, University of Hull, Hull, U.K.Faculty of Computer Science, University of Sunderland, St Peter Campus, Sunderland, U.K.The integrative analysis of multimodal medical images plays an important role in the diagnosis of coronary artery disease by providing additional comprehensive information that cannot be found in an individual source image. Intravascular ultrasound (IVUS) and optical coherence tomography (IV-OCT) are two imaging modalities that have been widely used in the medical practice for the assessment of arterial health and the detection of vascular lumen lesions. IV-OCT has a high resolution and poor penetration, while IVUS has a low resolution and high detection depth. This paper proposes a new approach for the fusion of intravascular ultrasound and optical coherence tomography pullbacks to significantly improve the use of those two types of medical images. It also presents a new two-phase multimodal fusion framework using a coarse-to-fine registration and a wavelet fusion method. In the coarse-registration process, we define a set of new feature points to match the IVUS image and IV-OCT image. Then, the improved quality image is obtained based on the integration of the mutual information of two types of images. Finally, the matched registered images are fused with an approach based on the new proposed wavelet algorithm. The experimental results demonstrate the performance of the proposed new approach for significantly enhancing both the precision and computational stability. The proposed approach is shown to be promising for providing additional information to enhance the diagnosis and enable a deeper understanding of atherosclerosis.https://ieeexplore.ieee.org/document/8362608/Intravascular ultrasound (IVUS)optical coherence tomography (OCT)wavelet fusionmutual information registrationfeature registration
spellingShingle Chenxi Huang
Yuan Xie
Yisha Lan
Yongtao Hao
Fei Chen
Yongqiang Cheng
Yonghong Peng
A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images
IEEE Access
Intravascular ultrasound (IVUS)
optical coherence tomography (OCT)
wavelet fusion
mutual information registration
feature registration
title A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images
title_full A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images
title_fullStr A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images
title_full_unstemmed A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images
title_short A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images
title_sort new framework for the integrative analytics of intravascular ultrasound and optical coherence tomography images
topic Intravascular ultrasound (IVUS)
optical coherence tomography (OCT)
wavelet fusion
mutual information registration
feature registration
url https://ieeexplore.ieee.org/document/8362608/
work_keys_str_mv AT chenxihuang anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yuanxie anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yishalan anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yongtaohao anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT feichen anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yongqiangcheng anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yonghongpeng anewframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT chenxihuang newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yuanxie newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yishalan newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yongtaohao newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT feichen newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yongqiangcheng newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages
AT yonghongpeng newframeworkfortheintegrativeanalyticsofintravascularultrasoundandopticalcoherencetomographyimages