Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study
BackgroundAs smartphone technology has become nearly ubiquitous, there is a growing body of literature suggesting that ecological momentary cognitive testing (EMCT) offers advantages over traditional pen-and-paper psychological assessment. We introduce a newly developed platf...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-07-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2022/7/e36665 |
| _version_ | 1827858170766163968 |
|---|---|
| author | Raeanne C Moore Emma M Parrish Ryan Van Patten Emily Paolillo Tess F Filip Jessica Bomyea Derek Lomas Elizabeth W Twamley Lisa T Eyler Colin A Depp |
| author_facet | Raeanne C Moore Emma M Parrish Ryan Van Patten Emily Paolillo Tess F Filip Jessica Bomyea Derek Lomas Elizabeth W Twamley Lisa T Eyler Colin A Depp |
| author_sort | Raeanne C Moore |
| collection | DOAJ |
| description |
BackgroundAs smartphone technology has become nearly ubiquitous, there is a growing body of literature suggesting that ecological momentary cognitive testing (EMCT) offers advantages over traditional pen-and-paper psychological assessment. We introduce a newly developed platform for the self-administration of cognitive tests in ecologically valid ways.
ObjectiveThe aim of this study is to develop a Health Insurance Portability and Accountability Act–compliant EMCT smartphone-based platform for the frequent and repeated testing of cognitive abilities in everyday life. This study examines the psychometric properties of 7 mobile cognitive tests covering domains of processing speed, visual working memory, recognition memory, and response inhibition within our platform among persons with and without bipolar disorder (BD). Ultimately, if shown to have adequate psychometric properties, EMCTs may be useful in research on BD and other neurological and psychiatric illnesses.
MethodsA total of 45 persons with BD and 21 demographically comparable healthy volunteer participants (aged 18-65 years) completed smartphone-based EMCTs 3 times daily for 14 days. Each EMCT session lasted approximately 1.5 minutes. Only 2 to 3 tests were administered in any given session, no test was administered more than once per day, and alternate test versions were administered in each session.
ResultsThe mean adherence to the EMCT protocol was 69.7% (SD 20.5%), resulting in 3965 valid and complete tests across the full sample. Participants were significantly more likely to miss tests on later versus earlier study days. Adherence did not differ by diagnostic status, suggesting that BD does not interfere with EMCT participation. In most tests, age and education were related to EMCT performance in expected directions. The average performances on most EMCTs were moderately to strongly correlated with the National Institutes of Health Toolbox Cognition Battery. Practice effects were observed in 5 tests, with significant differences in practice effects by BD status in 3 tests.
ConclusionsAlthough additional reliability and validity data are needed, this study provides initial psychometric support for EMCTs in the assessment of cognitive performance in real-world contexts in BD. |
| first_indexed | 2024-03-12T12:50:59Z |
| format | Article |
| id | doaj.art-da866e772f274a5699619514bb31d6b6 |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-03-12T12:50:59Z |
| publishDate | 2022-07-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-da866e772f274a5699619514bb31d6b62023-08-28T22:45:54ZengJMIR PublicationsJournal of Medical Internet Research1438-88712022-07-01247e3666510.2196/36665Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation StudyRaeanne C Moorehttps://orcid.org/0000-0002-7499-041XEmma M Parrishhttps://orcid.org/0000-0003-1937-8145Ryan Van Pattenhttps://orcid.org/0000-0002-6203-6688Emily Paolillohttps://orcid.org/0000-0003-4188-6998Tess F Filiphttps://orcid.org/0000-0001-6145-1428Jessica Bomyeahttps://orcid.org/0000-0001-9853-135XDerek Lomashttps://orcid.org/0000-0003-2329-7831Elizabeth W Twamleyhttps://orcid.org/0000-0002-8693-8782Lisa T Eylerhttps://orcid.org/0000-0002-7783-8798Colin A Depphttps://orcid.org/0000-0002-1841-6229 BackgroundAs smartphone technology has become nearly ubiquitous, there is a growing body of literature suggesting that ecological momentary cognitive testing (EMCT) offers advantages over traditional pen-and-paper psychological assessment. We introduce a newly developed platform for the self-administration of cognitive tests in ecologically valid ways. ObjectiveThe aim of this study is to develop a Health Insurance Portability and Accountability Act–compliant EMCT smartphone-based platform for the frequent and repeated testing of cognitive abilities in everyday life. This study examines the psychometric properties of 7 mobile cognitive tests covering domains of processing speed, visual working memory, recognition memory, and response inhibition within our platform among persons with and without bipolar disorder (BD). Ultimately, if shown to have adequate psychometric properties, EMCTs may be useful in research on BD and other neurological and psychiatric illnesses. MethodsA total of 45 persons with BD and 21 demographically comparable healthy volunteer participants (aged 18-65 years) completed smartphone-based EMCTs 3 times daily for 14 days. Each EMCT session lasted approximately 1.5 minutes. Only 2 to 3 tests were administered in any given session, no test was administered more than once per day, and alternate test versions were administered in each session. ResultsThe mean adherence to the EMCT protocol was 69.7% (SD 20.5%), resulting in 3965 valid and complete tests across the full sample. Participants were significantly more likely to miss tests on later versus earlier study days. Adherence did not differ by diagnostic status, suggesting that BD does not interfere with EMCT participation. In most tests, age and education were related to EMCT performance in expected directions. The average performances on most EMCTs were moderately to strongly correlated with the National Institutes of Health Toolbox Cognition Battery. Practice effects were observed in 5 tests, with significant differences in practice effects by BD status in 3 tests. ConclusionsAlthough additional reliability and validity data are needed, this study provides initial psychometric support for EMCTs in the assessment of cognitive performance in real-world contexts in BD.https://www.jmir.org/2022/7/e36665 |
| spellingShingle | Raeanne C Moore Emma M Parrish Ryan Van Patten Emily Paolillo Tess F Filip Jessica Bomyea Derek Lomas Elizabeth W Twamley Lisa T Eyler Colin A Depp Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study Journal of Medical Internet Research |
| title | Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study |
| title_full | Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study |
| title_fullStr | Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study |
| title_full_unstemmed | Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study |
| title_short | Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study |
| title_sort | initial psychometric properties of 7 neuroux remote ecological momentary cognitive tests among people with bipolar disorder validation study |
| url | https://www.jmir.org/2022/7/e36665 |
| work_keys_str_mv | AT raeannecmoore initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT emmamparrish initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT ryanvanpatten initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT emilypaolillo initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT tessffilip initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT jessicabomyea initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT dereklomas initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT elizabethwtwamley initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT lisateyler initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy AT colinadepp initialpsychometricpropertiesof7neurouxremoteecologicalmomentarycognitivetestsamongpeoplewithbipolardisordervalidationstudy |