Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery

BackgroundAs evidenced by the further reduction in access to testing during the COVID-19 pandemic, there is an urgent, growing need for remote cognitive assessment for individuals with cognitive impairment. The Neurotrack Cognitive Battery (NCB), our response to this need, wa...

Full description

Bibliographic Details
Main Authors: Jennifer Rae Myers, Jordan M Glenn, Erica N Madero, John Anderson, Rachel Mak-McCully, Michelle Gray, Joshua L Gills, John E Harrison
Format: Article
Language:English
Published: JMIR Publications 2022-02-01
Series:JMIR Formative Research
Online Access:https://formative.jmir.org/2022/2/e34237
_version_ 1797735365738496000
author Jennifer Rae Myers
Jordan M Glenn
Erica N Madero
John Anderson
Rachel Mak-McCully
Michelle Gray
Joshua L Gills
John E Harrison
author_facet Jennifer Rae Myers
Jordan M Glenn
Erica N Madero
John Anderson
Rachel Mak-McCully
Michelle Gray
Joshua L Gills
John E Harrison
author_sort Jennifer Rae Myers
collection DOAJ
description BackgroundAs evidenced by the further reduction in access to testing during the COVID-19 pandemic, there is an urgent, growing need for remote cognitive assessment for individuals with cognitive impairment. The Neurotrack Cognitive Battery (NCB), our response to this need, was evaluated for its temporal reliability and stability as part of ongoing validation testing. ObjectiveThe aim of this study is to assess the temporal reliability of the NCB tests (5 total) across a 1-week period and to determine the temporal stability of these measures across 3 consecutive administrations in a single day. MethodsFor test-retest reliability, a range of 29-66 cognitively healthy participants (ages 18-68 years) completed each cognitive assessment twice, 1 week apart. In a separate study, temporal stability was assessed using data collected from 31 different cognitively healthy participants at 3 consecutive timepoints in a single day. ResultsCorrelations for the assessments were between 0.72 and 0.83, exceeding the standard acceptable threshold of 0.70 for temporal reliability. Intraclass correlations ranged from 0.60 to 0.84, indicating moderate to good temporal stability. ConclusionsThese results highlight the NCB as a brief, easy-to-administer, and reliable assessment for remote cognitive testing. Additional validation research is underway to determine the full magnitude of the clinical utility of the NCB.
first_indexed 2024-03-12T12:56:59Z
format Article
id doaj.art-e9c661fbe75344f2972fee08608cbeba
institution Directory Open Access Journal
issn 2561-326X
language English
last_indexed 2024-03-12T12:56:59Z
publishDate 2022-02-01
publisher JMIR Publications
record_format Article
series JMIR Formative Research
spelling doaj.art-e9c661fbe75344f2972fee08608cbeba2023-08-28T20:49:59ZengJMIR PublicationsJMIR Formative Research2561-326X2022-02-0162e3423710.2196/34237Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive BatteryJennifer Rae Myershttps://orcid.org/0000-0003-1754-3784Jordan M Glennhttps://orcid.org/0000-0002-2563-4291Erica N Maderohttps://orcid.org/0000-0002-5112-2441John Andersonhttps://orcid.org/0000-0001-7823-9378Rachel Mak-McCullyhttps://orcid.org/0000-0001-5162-4911Michelle Grayhttps://orcid.org/0000-0001-5721-9087Joshua L Gillshttps://orcid.org/0000-0003-3321-4120John E Harrisonhttps://orcid.org/0000-0002-0225-4923 BackgroundAs evidenced by the further reduction in access to testing during the COVID-19 pandemic, there is an urgent, growing need for remote cognitive assessment for individuals with cognitive impairment. The Neurotrack Cognitive Battery (NCB), our response to this need, was evaluated for its temporal reliability and stability as part of ongoing validation testing. ObjectiveThe aim of this study is to assess the temporal reliability of the NCB tests (5 total) across a 1-week period and to determine the temporal stability of these measures across 3 consecutive administrations in a single day. MethodsFor test-retest reliability, a range of 29-66 cognitively healthy participants (ages 18-68 years) completed each cognitive assessment twice, 1 week apart. In a separate study, temporal stability was assessed using data collected from 31 different cognitively healthy participants at 3 consecutive timepoints in a single day. ResultsCorrelations for the assessments were between 0.72 and 0.83, exceeding the standard acceptable threshold of 0.70 for temporal reliability. Intraclass correlations ranged from 0.60 to 0.84, indicating moderate to good temporal stability. ConclusionsThese results highlight the NCB as a brief, easy-to-administer, and reliable assessment for remote cognitive testing. Additional validation research is underway to determine the full magnitude of the clinical utility of the NCB.https://formative.jmir.org/2022/2/e34237
spellingShingle Jennifer Rae Myers
Jordan M Glenn
Erica N Madero
John Anderson
Rachel Mak-McCully
Michelle Gray
Joshua L Gills
John E Harrison
Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery
JMIR Formative Research
title Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery
title_full Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery
title_fullStr Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery
title_full_unstemmed Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery
title_short Asynchronous Remote Assessment for Cognitive Impairment: Reliability Verification of the Neurotrack Cognitive Battery
title_sort asynchronous remote assessment for cognitive impairment reliability verification of the neurotrack cognitive battery
url https://formative.jmir.org/2022/2/e34237
work_keys_str_mv AT jenniferraemyers asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT jordanmglenn asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT ericanmadero asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT johnanderson asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT rachelmakmccully asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT michellegray asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT joshualgills asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery
AT johneharrison asynchronousremoteassessmentforcognitiveimpairmentreliabilityverificationoftheneurotrackcognitivebattery