Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI

Predicting individual behavior from brain imaging data using machine learning is a rapidly growing field in neuroscience. Functional connectivity (FC), which captures interactions between different brain regions, contains valuable information about the organization of the brain and is considered a c...

Full description

Bibliographic Details
Main Authors: Xuyun Wen, Qumei Cao, Bin Jing, Daoqiang Zhang
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Transactions on Neural Systems and Rehabilitation Engineering
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10411915/
_version_ 1797339287208853504
author Xuyun Wen
Qumei Cao
Bin Jing
Daoqiang Zhang
author_facet Xuyun Wen
Qumei Cao
Bin Jing
Daoqiang Zhang
author_sort Xuyun Wen
collection DOAJ
description Predicting individual behavior from brain imaging data using machine learning is a rapidly growing field in neuroscience. Functional connectivity (FC), which captures interactions between different brain regions, contains valuable information about the organization of the brain and is considered a crucial feature for modeling human behavior. Graph convolutional networks (GCN) have proven to be a powerful tool for extracting graph structure features and have shown promising results in various FC-based classification tasks, such as disease classification and prognosis prediction. Despite this success, few behavior prediction models currently exist based on GCN, and their performance is not satisfactory. To address this gap, a new model called the Multi-Scale FC-based Multi-Order GCN (MSFC-MO-GCN) was proposed in this paper. The model considers the hierarchical structure of the brain system and utilizes FCs inferred from multiple spatial scales as input to comprehensively characterize individual brain organization. To enhance the feature learning ability of GCN, a multi-order graph convolutional layer is incorporated, which uses multi-order neighbors to guide message passing and learns high-order graph information of nodal connections. Additionally, an inter-subject contrast constraint is designed to control the potential information redundancy of FCs among different spatial scales during the feature learning process. Experimental evaluation were conducted on the publicly available dataset from human connectome project. A total of 805 healthy subjects were included and 5 representative behavior metrics were used. The experimental results show that our proposed method outperforms the existing behavior prediction models in all behavior prediction tasks.
first_indexed 2024-03-08T09:43:49Z
format Article
id doaj.art-8b8f1e0b1de54c0492863addbcd72896
institution Directory Open Access Journal
issn 1558-0210
language English
last_indexed 2024-03-08T09:43:49Z
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Transactions on Neural Systems and Rehabilitation Engineering
spelling doaj.art-8b8f1e0b1de54c0492863addbcd728962024-01-30T00:00:17ZengIEEEIEEE Transactions on Neural Systems and Rehabilitation Engineering1558-02102024-01-013254855810.1109/TNSRE.2024.335705910411915Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRIXuyun Wen0https://orcid.org/0000-0003-2230-8658Qumei Cao1Bin Jing2https://orcid.org/0000-0002-4478-8683Daoqiang Zhang3https://orcid.org/0000-0003-2230-8658College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaCollege of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaSchool of Biomedical Engineering, Capital Medical University, Beijing, ChinaCollege of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, ChinaPredicting individual behavior from brain imaging data using machine learning is a rapidly growing field in neuroscience. Functional connectivity (FC), which captures interactions between different brain regions, contains valuable information about the organization of the brain and is considered a crucial feature for modeling human behavior. Graph convolutional networks (GCN) have proven to be a powerful tool for extracting graph structure features and have shown promising results in various FC-based classification tasks, such as disease classification and prognosis prediction. Despite this success, few behavior prediction models currently exist based on GCN, and their performance is not satisfactory. To address this gap, a new model called the Multi-Scale FC-based Multi-Order GCN (MSFC-MO-GCN) was proposed in this paper. The model considers the hierarchical structure of the brain system and utilizes FCs inferred from multiple spatial scales as input to comprehensively characterize individual brain organization. To enhance the feature learning ability of GCN, a multi-order graph convolutional layer is incorporated, which uses multi-order neighbors to guide message passing and learns high-order graph information of nodal connections. Additionally, an inter-subject contrast constraint is designed to control the potential information redundancy of FCs among different spatial scales during the feature learning process. Experimental evaluation were conducted on the publicly available dataset from human connectome project. A total of 805 healthy subjects were included and 5 representative behavior metrics were used. The experimental results show that our proposed method outperforms the existing behavior prediction models in all behavior prediction tasks.https://ieeexplore.ieee.org/document/10411915/Functional connectivityhuman behaviorgraph convolutional networkmulti-scalemulti-order
spellingShingle Xuyun Wen
Qumei Cao
Bin Jing
Daoqiang Zhang
Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI
IEEE Transactions on Neural Systems and Rehabilitation Engineering
Functional connectivity
human behavior
graph convolutional network
multi-scale
multi-order
title Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI
title_full Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI
title_fullStr Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI
title_full_unstemmed Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI
title_short Multi-Scale FC-Based Multi-Order GCN: A Novel Model for Predicting Individual Behavior From fMRI
title_sort multi scale fc based multi order gcn a novel model for predicting individual behavior from fmri
topic Functional connectivity
human behavior
graph convolutional network
multi-scale
multi-order
url https://ieeexplore.ieee.org/document/10411915/
work_keys_str_mv AT xuyunwen multiscalefcbasedmultiordergcnanovelmodelforpredictingindividualbehaviorfromfmri
AT qumeicao multiscalefcbasedmultiordergcnanovelmodelforpredictingindividualbehaviorfromfmri
AT binjing multiscalefcbasedmultiordergcnanovelmodelforpredictingindividualbehaviorfromfmri
AT daoqiangzhang multiscalefcbasedmultiordergcnanovelmodelforpredictingindividualbehaviorfromfmri