3D multi-modality medical image registration with GAN-based synthetic image augmentation

Medical image registration is a crucial yet challenging task in medical image analysis and processing. we propose an end-to-end unsupervised multi-modality deformable image registration network with CycleGAN augmentation. The proposed method is designed for intra-subject brain MRI-CT registration. T...

Full description

Bibliographic Details
Main Author: Guo, Zhiwei
Other Authors: Jagath C Rajapakse
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/152248
Description
Summary:Medical image registration is a crucial yet challenging task in medical image analysis and processing. we propose an end-to-end unsupervised multi-modality deformable image registration network with CycleGAN augmentation. The proposed method is designed for intra-subject brain MRI-CT registration. The registration network can be divided into two stage. First, it generates a synthetic CT image from its corresponding MRI image by using CycleGAN. Second, by feeding the synthetic CT (sCT) and original CT into an unsupervised registration network, the deformation field to align the sCT and CT image is obtained, which is also the deformation field applied to the MRI image to align with CT image. Compared with state-of-art unsupervised registration method, instead of calculating a single mono-modality image similarity on CT and warped sCT, we also include a mutual information multi-modality image similarity on CT and warped MRI. We demonstrated that our proposed method outperforms both current state-of-the-art registration algorithm and existing registration tools. Because of an impending Technical Disclosure, some details of methodology have been omitted in this report.