Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream

<strong>Background</strong> Large-scale longitudinal and multi-centre studies are used to explore neuroimaging markers of normal ageing, and neurodegenerative and mental health disorders. Longitudinal changes in brain structure are typically small, therefore the reliability of automated...

Full description

Bibliographic Details
Main Authors: Hedges, EP, Dimitrov, M, Zahid, U, Brito Vega, B, Si, S, Dickson, H, McGuire, P, Williams, S, Barker, GJ, Kempton, MJ
Format: Journal article
Language:English
Published: Elsevier 2021
_version_ 1797088887983570944
author Hedges, EP
Dimitrov, M
Zahid, U
Brito Vega, B
Si, S
Dickson, H
McGuire, P
Williams, S
Barker, GJ
Kempton, MJ
author_facet Hedges, EP
Dimitrov, M
Zahid, U
Brito Vega, B
Si, S
Dickson, H
McGuire, P
Williams, S
Barker, GJ
Kempton, MJ
author_sort Hedges, EP
collection OXFORD
description <strong>Background</strong> Large-scale longitudinal and multi-centre studies are used to explore neuroimaging markers of normal ageing, and neurodegenerative and mental health disorders. Longitudinal changes in brain structure are typically small, therefore the reliability of automated techniques is crucial. Determining the effects of different factors on reliability allows investigators to control those adversely affecting reliability, calculate statistical power, or even avoid particular brain measures with low reliability. This study examined the impact of several image acquisition and processing factors and documented the test-retest reliability of structural MRI measurements. <br> <strong>Methods</strong> In Phase I, 20 healthy adults (11 females; aged 20–30 years) were scanned on two occasions three weeks apart on the same scanner using the ADNI-3 protocol. On each occasion, individuals were scanned twice (repetition), after re-entering the scanner (reposition) and after tilting their head forward. At one year follow-up, nine returning individuals and 11 new volunteers were recruited for Phase II (11 females; aged 22–31 years). Scans were acquired on two different scanners using the ADNI-2 and ADNI-3 protocols. Structural images were processed using FreeSurfer (v5.3.0, 6.0.0 and 7.1.0) to provide subcortical and cortical volume, cortical surface area and thickness measurements. Intra-class correlation coefficients (ICC) were calculated to estimate test-retest reliability. We examined the effect of repetition, reposition, head tilt, time between scans, MRI sequence and scanner on reliability of structural brain measurements. Mean percentage differences were also calculated in supplementary analyses. <br> <strong>Results</strong> Using the FreeSurfer v7.1.0 longitudinal pipeline, we observed high reliability for subcortical and cortical volumes, and cortical surface areas at repetition, reposition, three weeks and one year (mean ICCs>0.97). Cortical thickness reliability was lower (mean ICCs>0.82). Head tilt had the greatest adverse impact on ICC estimates, for example reducing mean right cortical thickness to ICC=0.74. In contrast, changes in ADNI sequence or MRI scanner had a minimal effect. We observed an increase in reliability for updated FreeSurfer versions, with the longitudinal pipeline consistently having a higher reliability than the cross-sectional pipeline. <br> <strong>Discussion</strong> Longitudinal studies should monitor or control head tilt to maximise reliability. We provided the ICC estimates and mean percentage differences for all FreeSurfer brain regions, which may inform power analyses for clinical studies and have implications for the design of future longitudinal studies.
first_indexed 2024-03-07T02:56:34Z
format Journal article
id oxford-uuid:af7cf33e-d3c2-47f4-af7a-f589fdf1f83d
institution University of Oxford
language English
last_indexed 2024-03-07T02:56:34Z
publishDate 2021
publisher Elsevier
record_format dspace
spelling oxford-uuid:af7cf33e-d3c2-47f4-af7a-f589fdf1f83d2022-03-27T03:49:58ZReliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing streamJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:af7cf33e-d3c2-47f4-af7a-f589fdf1f83dEnglishSymplectic ElementsElsevier2021Hedges, EPDimitrov, MZahid, UBrito Vega, BSi, SDickson, HMcGuire, PWilliams, SBarker, GJKempton, MJ<strong>Background</strong> Large-scale longitudinal and multi-centre studies are used to explore neuroimaging markers of normal ageing, and neurodegenerative and mental health disorders. Longitudinal changes in brain structure are typically small, therefore the reliability of automated techniques is crucial. Determining the effects of different factors on reliability allows investigators to control those adversely affecting reliability, calculate statistical power, or even avoid particular brain measures with low reliability. This study examined the impact of several image acquisition and processing factors and documented the test-retest reliability of structural MRI measurements. <br> <strong>Methods</strong> In Phase I, 20 healthy adults (11 females; aged 20–30 years) were scanned on two occasions three weeks apart on the same scanner using the ADNI-3 protocol. On each occasion, individuals were scanned twice (repetition), after re-entering the scanner (reposition) and after tilting their head forward. At one year follow-up, nine returning individuals and 11 new volunteers were recruited for Phase II (11 females; aged 22–31 years). Scans were acquired on two different scanners using the ADNI-2 and ADNI-3 protocols. Structural images were processed using FreeSurfer (v5.3.0, 6.0.0 and 7.1.0) to provide subcortical and cortical volume, cortical surface area and thickness measurements. Intra-class correlation coefficients (ICC) were calculated to estimate test-retest reliability. We examined the effect of repetition, reposition, head tilt, time between scans, MRI sequence and scanner on reliability of structural brain measurements. Mean percentage differences were also calculated in supplementary analyses. <br> <strong>Results</strong> Using the FreeSurfer v7.1.0 longitudinal pipeline, we observed high reliability for subcortical and cortical volumes, and cortical surface areas at repetition, reposition, three weeks and one year (mean ICCs>0.97). Cortical thickness reliability was lower (mean ICCs>0.82). Head tilt had the greatest adverse impact on ICC estimates, for example reducing mean right cortical thickness to ICC=0.74. In contrast, changes in ADNI sequence or MRI scanner had a minimal effect. We observed an increase in reliability for updated FreeSurfer versions, with the longitudinal pipeline consistently having a higher reliability than the cross-sectional pipeline. <br> <strong>Discussion</strong> Longitudinal studies should monitor or control head tilt to maximise reliability. We provided the ICC estimates and mean percentage differences for all FreeSurfer brain regions, which may inform power analyses for clinical studies and have implications for the design of future longitudinal studies.
spellingShingle Hedges, EP
Dimitrov, M
Zahid, U
Brito Vega, B
Si, S
Dickson, H
McGuire, P
Williams, S
Barker, GJ
Kempton, MJ
Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream
title Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream
title_full Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream
title_fullStr Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream
title_full_unstemmed Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream
title_short Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream
title_sort reliability of structural mri measurements the effects of scan session head tilt inter scan interval acquisition sequence freesurfer version and processing stream
work_keys_str_mv AT hedgesep reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT dimitrovm reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT zahidu reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT britovegab reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT sis reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT dicksonh reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT mcguirep reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT williamss reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT barkergj reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream
AT kemptonmj reliabilityofstructuralmrimeasurementstheeffectsofscansessionheadtiltinterscanintervalacquisitionsequencefreesurferversionandprocessingstream