Non-parametric combination and related permutation tests for neuroimaging

In this work, we show how permutation methods can be applied to combination analyses such as those that include multiple imaging modalities, multiple data acquisitions of the same modality, or simply multiple hypotheses on the same data. Using the well-known definition of union-intersection tests an...

Full description

Bibliographic Details
Main Authors: Winkler, A, Webster, M, Brooks, J, Tracey, I, Smith, S, Nichols, T
Format: Journal article
Language:English
Published: Wiley 2016
_version_ 1826259276604112896
author Winkler, A
Webster, M
Brooks, J
Tracey, I
Smith, S
Nichols, T
author_facet Winkler, A
Webster, M
Brooks, J
Tracey, I
Smith, S
Nichols, T
author_sort Winkler, A
collection OXFORD
description In this work, we show how permutation methods can be applied to combination analyses such as those that include multiple imaging modalities, multiple data acquisitions of the same modality, or simply multiple hypotheses on the same data. Using the well-known definition of union-intersection tests and closed testing procedures, we use synchronized permutations to correct for such multiplicity of tests, allowing flexibility to integrate imaging data with different spatial resolutions, surface and/or volume-based representations of the brain, including non-imaging data. For the problem of joint inference, we propose and evaluate a modification of the recently introduced non-parametric combination (NPC) methodology, such that instead of a two-phase algorithm and large data storage requirements, the inference can be performed in a single phase, with reasonable computational demands. The method compares favorably to classical multivariate tests (such as MANCOVA), even when the latter is assessed using permutations. We also evaluate, in the context of permutation tests, various combining methods that have been proposed in the past decades, and identify those that provide the best control over error rate and power across a range of situations. We show that one of these, the method of Tippett, provides a link between correction for the multiplicity of tests and their combination. Finally, we discuss how the correction can solve certain problems of multiple comparisons in one-way ANOVA designs, and how the combination is distinguished from conjunctions, even though both can be assessed using permutation tests. We also provide a common algorithm that accommodates combination and correction. Hum Brain Mapp 37:1486-1511, 2016. © 2016 Wiley Periodicals, Inc.
first_indexed 2024-03-06T18:47:18Z
format Journal article
id oxford-uuid:0ef262a7-4cc0-47ee-8ae6-69a49318033b
institution University of Oxford
language English
last_indexed 2024-03-06T18:47:18Z
publishDate 2016
publisher Wiley
record_format dspace
spelling oxford-uuid:0ef262a7-4cc0-47ee-8ae6-69a49318033b2022-03-26T09:48:48ZNon-parametric combination and related permutation tests for neuroimagingJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:0ef262a7-4cc0-47ee-8ae6-69a49318033bEnglishSymplectic Elements at OxfordWiley2016Winkler, AWebster, MBrooks, JTracey, ISmith, SNichols, TIn this work, we show how permutation methods can be applied to combination analyses such as those that include multiple imaging modalities, multiple data acquisitions of the same modality, or simply multiple hypotheses on the same data. Using the well-known definition of union-intersection tests and closed testing procedures, we use synchronized permutations to correct for such multiplicity of tests, allowing flexibility to integrate imaging data with different spatial resolutions, surface and/or volume-based representations of the brain, including non-imaging data. For the problem of joint inference, we propose and evaluate a modification of the recently introduced non-parametric combination (NPC) methodology, such that instead of a two-phase algorithm and large data storage requirements, the inference can be performed in a single phase, with reasonable computational demands. The method compares favorably to classical multivariate tests (such as MANCOVA), even when the latter is assessed using permutations. We also evaluate, in the context of permutation tests, various combining methods that have been proposed in the past decades, and identify those that provide the best control over error rate and power across a range of situations. We show that one of these, the method of Tippett, provides a link between correction for the multiplicity of tests and their combination. Finally, we discuss how the correction can solve certain problems of multiple comparisons in one-way ANOVA designs, and how the combination is distinguished from conjunctions, even though both can be assessed using permutation tests. We also provide a common algorithm that accommodates combination and correction. Hum Brain Mapp 37:1486-1511, 2016. © 2016 Wiley Periodicals, Inc.
spellingShingle Winkler, A
Webster, M
Brooks, J
Tracey, I
Smith, S
Nichols, T
Non-parametric combination and related permutation tests for neuroimaging
title Non-parametric combination and related permutation tests for neuroimaging
title_full Non-parametric combination and related permutation tests for neuroimaging
title_fullStr Non-parametric combination and related permutation tests for neuroimaging
title_full_unstemmed Non-parametric combination and related permutation tests for neuroimaging
title_short Non-parametric combination and related permutation tests for neuroimaging
title_sort non parametric combination and related permutation tests for neuroimaging
work_keys_str_mv AT winklera nonparametriccombinationandrelatedpermutationtestsforneuroimaging
AT websterm nonparametriccombinationandrelatedpermutationtestsforneuroimaging
AT brooksj nonparametriccombinationandrelatedpermutationtestsforneuroimaging
AT traceyi nonparametriccombinationandrelatedpermutationtestsforneuroimaging
AT smiths nonparametriccombinationandrelatedpermutationtestsforneuroimaging
AT nicholst nonparametriccombinationandrelatedpermutationtestsforneuroimaging