Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification

Over the last few decades, a study of human brain, or neuroscience, has grown in a significant rate. Countless researches of how our brain functions have been published. An interesting technique is to model human brain as the comprehensive map of neurons. With this perspective, it can be further stu...

Full description

Bibliographic Details
Main Author: Tieu, Phat Dat
Other Authors: Jagath C Rajapakse
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/156570
_version_ 1826127082519789568
author Tieu, Phat Dat
author2 Jagath C Rajapakse
author_facet Jagath C Rajapakse
Tieu, Phat Dat
author_sort Tieu, Phat Dat
collection NTU
description Over the last few decades, a study of human brain, or neuroscience, has grown in a significant rate. Countless researches of how our brain functions have been published. An interesting technique is to model human brain as the comprehensive map of neurons. With this perspective, it can be further studied via Structural Connectome (SC), which is a network of anatomical white matter connections in the brain, and Functional Connectome (FC), which is commonly used to assess whole brain dynamics and function. Understanding the connection between SC and FC would definitely contribute a lot to neuroscience field. This justifies the need for multi-view learning techniques to encode large datasets that combine both the brain and SC and FC. In this project, our objective is to study the cross-modal synthesis of human connectome by proposing an approach to produce SC matrices from FC matrices and vice versa, using the state-of-the-art generative model, CycleGAN. Once the synthetic samples have been created, we combine them with the orginal samples to perform multi-view disease classification, by utilizing our lab’s Convolutional Neural Network (CNN) model. This analysis aims to evaluate the improvement in classification task results when applying these simulated data.
first_indexed 2024-10-01T07:02:56Z
format Final Year Project (FYP)
id ntu-10356/156570
institution Nanyang Technological University
language English
last_indexed 2024-10-01T07:02:56Z
publishDate 2022
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1565702022-04-20T07:28:47Z Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification Tieu, Phat Dat Jagath C Rajapakse School of Computer Science and Engineering ASJagath@ntu.edu.sg Engineering::Bioengineering Over the last few decades, a study of human brain, or neuroscience, has grown in a significant rate. Countless researches of how our brain functions have been published. An interesting technique is to model human brain as the comprehensive map of neurons. With this perspective, it can be further studied via Structural Connectome (SC), which is a network of anatomical white matter connections in the brain, and Functional Connectome (FC), which is commonly used to assess whole brain dynamics and function. Understanding the connection between SC and FC would definitely contribute a lot to neuroscience field. This justifies the need for multi-view learning techniques to encode large datasets that combine both the brain and SC and FC. In this project, our objective is to study the cross-modal synthesis of human connectome by proposing an approach to produce SC matrices from FC matrices and vice versa, using the state-of-the-art generative model, CycleGAN. Once the synthetic samples have been created, we combine them with the orginal samples to perform multi-view disease classification, by utilizing our lab’s Convolutional Neural Network (CNN) model. This analysis aims to evaluate the improvement in classification task results when applying these simulated data. Bachelor of Engineering (Computer Science) 2022-04-20T07:28:47Z 2022-04-20T07:28:47Z 2022 Final Year Project (FYP) Tieu, P. D. (2022). Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156570 https://hdl.handle.net/10356/156570 en SCSE21-0426 application/pdf Nanyang Technological University
spellingShingle Engineering::Bioengineering
Tieu, Phat Dat
Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification
title Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification
title_full Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification
title_fullStr Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification
title_full_unstemmed Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification
title_short Cross-modal synthesis of structural and functional connectome with CycleGAN for disease classification
title_sort cross modal synthesis of structural and functional connectome with cyclegan for disease classification
topic Engineering::Bioengineering
url https://hdl.handle.net/10356/156570
work_keys_str_mv AT tieuphatdat crossmodalsynthesisofstructuralandfunctionalconnectomewithcycleganfordiseaseclassification