Generalizing prediction of task-evoked brain activity across datasets and populations

Predictions of task-based functional magnetic resonance imaging (fMRI) from task-free resting-state (rs) fMRI have gained popularity over the past decade. This method holds a great promise for studying individual variability in brain function without the need to perform highly demanding tasks. Howev...

Full description

Bibliographic Details
Main Authors: Niv Tik, Shachar Gal, Asaf Madar, Tamar Ben-David, Michal Bernstein-Eliav, Ido Tavor
Format: Article
Language:English
Published: Elsevier 2023-08-01
Series:NeuroImage
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S1053811923003646
_version_ 1797799089934434304
author Niv Tik
Shachar Gal
Asaf Madar
Tamar Ben-David
Michal Bernstein-Eliav
Ido Tavor
author_facet Niv Tik
Shachar Gal
Asaf Madar
Tamar Ben-David
Michal Bernstein-Eliav
Ido Tavor
author_sort Niv Tik
collection DOAJ
description Predictions of task-based functional magnetic resonance imaging (fMRI) from task-free resting-state (rs) fMRI have gained popularity over the past decade. This method holds a great promise for studying individual variability in brain function without the need to perform highly demanding tasks. However, in order to be broadly used, prediction models must prove to generalize beyond the dataset they were trained on. In this work, we test the generalizability of prediction of task-fMRI from rs-fMRI across sites, MRI vendors and age-groups. Moreover, we investigate the data requirements for successful prediction. We use the Human Connectome Project (HCP) dataset to explore how different combinations of training sample sizes and number of fMRI datapoints affect prediction success in various cognitive tasks. We then apply models trained on HCP data to predict brain activations in data from a different site, a different MRI vendor (Phillips vs. Siemens scanners) and a different age group (children from the HCP-development project). We demonstrate that, depending on the task, a training set of approximately 20 participants with 100 fMRI timepoints each yields the largest gain in model performance. Nevertheless, further increasing sample size and number of timepoints results in significantly improved predictions, until reaching approximately 450–600 training participants and 800–1000 timepoints. Overall, the number of fMRI timepoints influences prediction success more than the sample size. We further show that models trained on adequate amounts of data successfully generalize across sites, vendors and age groups and provide predictions that are both accurate and individual-specific. These findings suggest that large-scale publicly available datasets may be utilized to study brain function in smaller, unique samples.
first_indexed 2024-03-13T04:14:46Z
format Article
id doaj.art-9149b818ca5b4aabb6b79b6520326b4e
institution Directory Open Access Journal
issn 1095-9572
language English
last_indexed 2024-03-13T04:14:46Z
publishDate 2023-08-01
publisher Elsevier
record_format Article
series NeuroImage
spelling doaj.art-9149b818ca5b4aabb6b79b6520326b4e2023-06-21T06:51:13ZengElsevierNeuroImage1095-95722023-08-01276120213Generalizing prediction of task-evoked brain activity across datasets and populationsNiv Tik0Shachar Gal1Asaf Madar2Tamar Ben-David3Michal Bernstein-Eliav4Ido Tavor5Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, IsraelSackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, IsraelSackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, IsraelSackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, IsraelSackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, IsraelSackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel; Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel; Strauss Center for Computational Neuroimaging, Tel Aviv University, Tel Aviv, Israel; Corresponding author at: Department of Anatomy and Anthropology, Sackler Faculty of Medicine, Tel Aviv University, Ramat Aviv 6997801, Israel.Predictions of task-based functional magnetic resonance imaging (fMRI) from task-free resting-state (rs) fMRI have gained popularity over the past decade. This method holds a great promise for studying individual variability in brain function without the need to perform highly demanding tasks. However, in order to be broadly used, prediction models must prove to generalize beyond the dataset they were trained on. In this work, we test the generalizability of prediction of task-fMRI from rs-fMRI across sites, MRI vendors and age-groups. Moreover, we investigate the data requirements for successful prediction. We use the Human Connectome Project (HCP) dataset to explore how different combinations of training sample sizes and number of fMRI datapoints affect prediction success in various cognitive tasks. We then apply models trained on HCP data to predict brain activations in data from a different site, a different MRI vendor (Phillips vs. Siemens scanners) and a different age group (children from the HCP-development project). We demonstrate that, depending on the task, a training set of approximately 20 participants with 100 fMRI timepoints each yields the largest gain in model performance. Nevertheless, further increasing sample size and number of timepoints results in significantly improved predictions, until reaching approximately 450–600 training participants and 800–1000 timepoints. Overall, the number of fMRI timepoints influences prediction success more than the sample size. We further show that models trained on adequate amounts of data successfully generalize across sites, vendors and age groups and provide predictions that are both accurate and individual-specific. These findings suggest that large-scale publicly available datasets may be utilized to study brain function in smaller, unique samples.http://www.sciencedirect.com/science/article/pii/S1053811923003646Predictive modellingTask-fMRIResting-state fMRIFunctional connectivityGeneralizabilityData sharing
spellingShingle Niv Tik
Shachar Gal
Asaf Madar
Tamar Ben-David
Michal Bernstein-Eliav
Ido Tavor
Generalizing prediction of task-evoked brain activity across datasets and populations
NeuroImage
Predictive modelling
Task-fMRI
Resting-state fMRI
Functional connectivity
Generalizability
Data sharing
title Generalizing prediction of task-evoked brain activity across datasets and populations
title_full Generalizing prediction of task-evoked brain activity across datasets and populations
title_fullStr Generalizing prediction of task-evoked brain activity across datasets and populations
title_full_unstemmed Generalizing prediction of task-evoked brain activity across datasets and populations
title_short Generalizing prediction of task-evoked brain activity across datasets and populations
title_sort generalizing prediction of task evoked brain activity across datasets and populations
topic Predictive modelling
Task-fMRI
Resting-state fMRI
Functional connectivity
Generalizability
Data sharing
url http://www.sciencedirect.com/science/article/pii/S1053811923003646
work_keys_str_mv AT nivtik generalizingpredictionoftaskevokedbrainactivityacrossdatasetsandpopulations
AT shachargal generalizingpredictionoftaskevokedbrainactivityacrossdatasetsandpopulations
AT asafmadar generalizingpredictionoftaskevokedbrainactivityacrossdatasetsandpopulations
AT tamarbendavid generalizingpredictionoftaskevokedbrainactivityacrossdatasetsandpopulations
AT michalbernsteineliav generalizingpredictionoftaskevokedbrainactivityacrossdatasetsandpopulations
AT idotavor generalizingpredictionoftaskevokedbrainactivityacrossdatasetsandpopulations