3D multi-modality medical image registration with GAN-based synthetic image augmentation
Medical image registration is a crucial yet challenging task in medical image analysis and processing. we propose an end-to-end unsupervised multi-modality deformable image registration network with CycleGAN augmentation. The proposed method is designed for intra-subject brain MRI-CT registration. T...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/152248 |
| _version_ | 1811695703311777792 |
|---|---|
| author | Guo, Zhiwei |
| author2 | Jagath C Rajapakse |
| author_facet | Jagath C Rajapakse Guo, Zhiwei |
| author_sort | Guo, Zhiwei |
| collection | NTU |
| description | Medical image registration is a crucial yet challenging task in medical image analysis and processing. we propose an end-to-end unsupervised multi-modality deformable image registration network with CycleGAN augmentation. The proposed method is designed for intra-subject brain MRI-CT registration. The registration network can be divided into two stage. First, it generates a synthetic CT image from its corresponding MRI image by using CycleGAN. Second, by feeding the synthetic CT (sCT) and original CT into an unsupervised registration network, the deformation field to align the sCT and CT image is obtained, which is also the deformation field applied to the MRI image to align with CT image. Compared with state-of-art unsupervised registration method, instead of calculating a single mono-modality image similarity on CT and warped sCT, we also include a mutual information multi-modality image similarity on CT and warped MRI. We demonstrated that our proposed method outperforms both current state-of-the-art registration algorithm and existing registration tools. Because of an impending Technical Disclosure, some details of methodology have been omitted in this report. |
| first_indexed | 2024-10-01T07:27:41Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/152248 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:27:41Z |
| publishDate | 2021 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1522482021-08-02T02:30:07Z 3D multi-modality medical image registration with GAN-based synthetic image augmentation Guo, Zhiwei Jagath C Rajapakse School of Computer Science and Engineering ASJagath@ntu.edu.sg Engineering::Computer science and engineering Medical image registration is a crucial yet challenging task in medical image analysis and processing. we propose an end-to-end unsupervised multi-modality deformable image registration network with CycleGAN augmentation. The proposed method is designed for intra-subject brain MRI-CT registration. The registration network can be divided into two stage. First, it generates a synthetic CT image from its corresponding MRI image by using CycleGAN. Second, by feeding the synthetic CT (sCT) and original CT into an unsupervised registration network, the deformation field to align the sCT and CT image is obtained, which is also the deformation field applied to the MRI image to align with CT image. Compared with state-of-art unsupervised registration method, instead of calculating a single mono-modality image similarity on CT and warped sCT, we also include a mutual information multi-modality image similarity on CT and warped MRI. We demonstrated that our proposed method outperforms both current state-of-the-art registration algorithm and existing registration tools. Because of an impending Technical Disclosure, some details of methodology have been omitted in this report. Bachelor of Engineering (Computer Science) 2021-07-26T01:27:54Z 2021-07-26T01:27:54Z 2021 Final Year Project (FYP) Guo, Z. (2021). 3D multi-modality medical image registration with GAN-based synthetic image augmentation. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/152248 https://hdl.handle.net/10356/152248 en application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering Guo, Zhiwei 3D multi-modality medical image registration with GAN-based synthetic image augmentation |
| title | 3D multi-modality medical image registration with GAN-based synthetic image augmentation |
| title_full | 3D multi-modality medical image registration with GAN-based synthetic image augmentation |
| title_fullStr | 3D multi-modality medical image registration with GAN-based synthetic image augmentation |
| title_full_unstemmed | 3D multi-modality medical image registration with GAN-based synthetic image augmentation |
| title_short | 3D multi-modality medical image registration with GAN-based synthetic image augmentation |
| title_sort | 3d multi modality medical image registration with gan based synthetic image augmentation |
| topic | Engineering::Computer science and engineering |
| url | https://hdl.handle.net/10356/152248 |
| work_keys_str_mv | AT guozhiwei 3dmultimodalitymedicalimageregistrationwithganbasedsyntheticimageaugmentation |