Enhancing the depth perception of DSA images with 2D–3D registration

ObjectiveToday, cerebrovascular disease has become an important health hazard. Therefore, it is necessary to perform a more accurate and less time-consuming registration of preoperative three-dimensional (3D) images and intraoperative two-dimensional (2D) projection images which is very important fo...

Full description

Bibliographic Details
Main Authors: Xiaofeng Zhang, Yongzhi Deng, Congyu Tian, Shu Chen, Yuanqing Wang, Meng Zhang, Qiong Wang, Xiangyun Liao, Weixin Si
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-02-01
Series:Frontiers in Neurology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fneur.2023.1122021/full
_version_ 1828039552739049472
author Xiaofeng Zhang
Yongzhi Deng
Congyu Tian
Shu Chen
Yuanqing Wang
Meng Zhang
Qiong Wang
Xiangyun Liao
Weixin Si
author_facet Xiaofeng Zhang
Yongzhi Deng
Congyu Tian
Shu Chen
Yuanqing Wang
Meng Zhang
Qiong Wang
Xiangyun Liao
Weixin Si
author_sort Xiaofeng Zhang
collection DOAJ
description ObjectiveToday, cerebrovascular disease has become an important health hazard. Therefore, it is necessary to perform a more accurate and less time-consuming registration of preoperative three-dimensional (3D) images and intraoperative two-dimensional (2D) projection images which is very important for conducting cerebrovascular disease interventions. The 2D–3D registration method proposed in this study is designed to solve the problems of long registration time and large registration errors in 3D computed tomography angiography (CTA) images and 2D digital subtraction angiography (DSA) images.MethodsTo make a more comprehensive and active diagnosis, treatment and surgery plan for patients with cerebrovascular diseases, we propose a weighted similarity measure function, the normalized mutual information-gradient difference (NMG), which can evaluate the 2D–3D registration results. Then, using a multi-resolution fusion optimization strategy, the multi-resolution fused regular step gradient descent optimization (MR-RSGD) method is presented to attain the optimal value of the registration results in the process of the optimization algorithm.ResultIn this study, we adopt two datasets of the brain vessels to validate and obtain similarity metric values which are 0.0037 and 0.0003, respectively. Using the registration method proposed in this study, the time taken for the experiment was calculated to be 56.55s and 50.8070s, respectively, for the two sets of data. The results show that the registration methods proposed in this study are both better than the Normalized Mutual (NM) and Normalized Mutual Information (NMI).ConclusionThe experimental results in this study show that in the 2D–3D registration process, to evaluate the registration results more accurately, we can use the similarity metric function containing the image gray information and spatial information. To improve the efficiency of the registration process, we can choose the algorithm with gradient optimization strategy. Our method has great potential to be applied in practical interventional treatment for intuitive 3D navigation.
first_indexed 2024-04-10T16:42:48Z
format Article
id doaj.art-fbbac00d02864cf29251d496e365aa16
institution Directory Open Access Journal
issn 1664-2295
language English
last_indexed 2024-04-10T16:42:48Z
publishDate 2023-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Neurology
spelling doaj.art-fbbac00d02864cf29251d496e365aa162023-02-08T05:59:12ZengFrontiers Media S.A.Frontiers in Neurology1664-22952023-02-011410.3389/fneur.2023.11220211122021Enhancing the depth perception of DSA images with 2D–3D registrationXiaofeng Zhang0Yongzhi Deng1Congyu Tian2Shu Chen3Yuanqing Wang4Meng Zhang5Qiong Wang6Xiangyun Liao7Weixin Si8Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, ChinaDepartment of Cardiovascular Surgery, Shanxi Clinical Medical Research Center for Cardiovascular Disease, Shanxi Institute of Cardiovascular Diseases, Shanxi Cardiovascular Hospital, Shanxi Medical University, Taiyuan, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, ChinaDepartment of Cardiovascular Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, ChinaShenzhen Second People's Hospital, Shenzhen, ChinaShenzhen Second People's Hospital, Shenzhen, ChinaGuangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, ChinaObjectiveToday, cerebrovascular disease has become an important health hazard. Therefore, it is necessary to perform a more accurate and less time-consuming registration of preoperative three-dimensional (3D) images and intraoperative two-dimensional (2D) projection images which is very important for conducting cerebrovascular disease interventions. The 2D–3D registration method proposed in this study is designed to solve the problems of long registration time and large registration errors in 3D computed tomography angiography (CTA) images and 2D digital subtraction angiography (DSA) images.MethodsTo make a more comprehensive and active diagnosis, treatment and surgery plan for patients with cerebrovascular diseases, we propose a weighted similarity measure function, the normalized mutual information-gradient difference (NMG), which can evaluate the 2D–3D registration results. Then, using a multi-resolution fusion optimization strategy, the multi-resolution fused regular step gradient descent optimization (MR-RSGD) method is presented to attain the optimal value of the registration results in the process of the optimization algorithm.ResultIn this study, we adopt two datasets of the brain vessels to validate and obtain similarity metric values which are 0.0037 and 0.0003, respectively. Using the registration method proposed in this study, the time taken for the experiment was calculated to be 56.55s and 50.8070s, respectively, for the two sets of data. The results show that the registration methods proposed in this study are both better than the Normalized Mutual (NM) and Normalized Mutual Information (NMI).ConclusionThe experimental results in this study show that in the 2D–3D registration process, to evaluate the registration results more accurately, we can use the similarity metric function containing the image gray information and spatial information. To improve the efficiency of the registration process, we can choose the algorithm with gradient optimization strategy. Our method has great potential to be applied in practical interventional treatment for intuitive 3D navigation.https://www.frontiersin.org/articles/10.3389/fneur.2023.1122021/full2D–3D registrationweighted similarity measure functionmulti-resolution fusion optimization strategypyramid convolutiontreatment of cerebrovascular diseases
spellingShingle Xiaofeng Zhang
Yongzhi Deng
Congyu Tian
Shu Chen
Yuanqing Wang
Meng Zhang
Qiong Wang
Xiangyun Liao
Weixin Si
Enhancing the depth perception of DSA images with 2D–3D registration
Frontiers in Neurology
2D–3D registration
weighted similarity measure function
multi-resolution fusion optimization strategy
pyramid convolution
treatment of cerebrovascular diseases
title Enhancing the depth perception of DSA images with 2D–3D registration
title_full Enhancing the depth perception of DSA images with 2D–3D registration
title_fullStr Enhancing the depth perception of DSA images with 2D–3D registration
title_full_unstemmed Enhancing the depth perception of DSA images with 2D–3D registration
title_short Enhancing the depth perception of DSA images with 2D–3D registration
title_sort enhancing the depth perception of dsa images with 2d 3d registration
topic 2D–3D registration
weighted similarity measure function
multi-resolution fusion optimization strategy
pyramid convolution
treatment of cerebrovascular diseases
url https://www.frontiersin.org/articles/10.3389/fneur.2023.1122021/full
work_keys_str_mv AT xiaofengzhang enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT yongzhideng enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT congyutian enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT shuchen enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT yuanqingwang enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT mengzhang enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT qiongwang enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT xiangyunliao enhancingthedepthperceptionofdsaimageswith2d3dregistration
AT weixinsi enhancingthedepthperceptionofdsaimageswith2d3dregistration