A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study
BackgroundMany people with harmful addictive behaviors may not meet formal diagnostic thresholds for a disorder. A dimensional approach, by contrast, including clinical and community samples, is potentially key to early detection, prevention, and intervention. Importantly, wh...
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2023-08-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2023/1/e44414 |
| _version_ | 1827860376551686144 |
|---|---|
| author | Rico S C Lee Lucy Albertella Erynn Christensen Chao Suo Rebecca A Segrave Maja Brydevall Rebecca Kirkham Chang Liu Leonardo F Fontenelle Samuel R Chamberlain Kristian Rotaru Murat Yücel |
| author_facet | Rico S C Lee Lucy Albertella Erynn Christensen Chao Suo Rebecca A Segrave Maja Brydevall Rebecca Kirkham Chang Liu Leonardo F Fontenelle Samuel R Chamberlain Kristian Rotaru Murat Yücel |
| author_sort | Rico S C Lee |
| collection | DOAJ |
| description |
BackgroundMany people with harmful addictive behaviors may not meet formal diagnostic thresholds for a disorder. A dimensional approach, by contrast, including clinical and community samples, is potentially key to early detection, prevention, and intervention. Importantly, while neurocognitive dysfunction underpins addictive behaviors, established assessment tools for neurocognitive assessment are lengthy and unengaging, difficult to administer at scale, and not suited to clinical or community needs. The BrainPark Assessment of Cognition (BrainPAC) Project sought to develop and validate an engaging and user-friendly digital assessment tool purpose-built to comprehensively assess the main consensus-driven constructs underpinning addictive behaviors.
ObjectiveThe purpose of this study was to psychometrically validate a gamified battery of consensus-based neurocognitive tasks against standard laboratory paradigms, ascertain test-retest reliability, and determine their sensitivity to addictive behaviors (eg, alcohol use) and other risk factors (eg, trait impulsivity).
MethodsGold standard laboratory paradigms were selected to measure key neurocognitive constructs (Balloon Analogue Risk Task [BART], Stop Signal Task [SST], Delay Discounting Task [DDT], Value-Modulated Attentional Capture [VMAC] Task, and Sequential Decision-Making Task [SDT]), as endorsed by an international panel of addiction experts; namely, response selection and inhibition, reward valuation, action selection, reward learning, expectancy and reward prediction error, habit, and compulsivity. Working with game developers, BrainPAC tasks were developed and validated in 3 successive cohorts (total N=600) and a separate test-retest cohort (N=50) via Mechanical Turk using a cross-sectional design.
ResultsBrainPAC tasks were significantly correlated with the original laboratory paradigms on most metrics (r=0.18-0.63, P<.05). With the exception of the DDT k function and VMAC total points, all other task metrics across the 5 tasks did not differ between the gamified and nongamified versions (P>.05). Out of 5 tasks, 4 demonstrated adequate to excellent test-retest reliability (intraclass correlation coefficient 0.72-0.91, P<.001; except SDT). Gamified metrics were significantly associated with addictive behaviors on behavioral inventories, though largely independent of trait-based scales known to predict addiction risk.
ConclusionsA purpose-built battery of digitally gamified tasks is sufficiently valid for the scalable assessment of key neurocognitive processes underpinning addictive behaviors. This validation provides evidence that a novel approach, purported to enhance task engagement, in the assessment of addiction-related neurocognition is feasible and empirically defensible. These findings have significant implications for risk detection and the successful deployment of next-generation assessment tools for substance use or misuse and other mental disorders characterized by neurocognitive anomalies related to motivation and self-regulation. Future development and validation of the BrainPAC tool should consider further enhancing convergence with established measures as well as collecting population-representative data to use clinically as normative comparisons. |
| first_indexed | 2024-03-12T13:22:11Z |
| format | Article |
| id | doaj.art-44d47e03e38a4b50ac64c33fdfd2c0e7 |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-03-12T13:22:11Z |
| publishDate | 2023-08-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-44d47e03e38a4b50ac64c33fdfd2c0e72023-08-25T14:31:30ZengJMIR PublicationsJournal of Medical Internet Research1438-88712023-08-0125e4441410.2196/44414A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation StudyRico S C Leehttps://orcid.org/0000-0001-8436-0190Lucy Albertellahttps://orcid.org/0000-0001-5232-6414Erynn Christensenhttps://orcid.org/0000-0001-7260-184XChao Suohttps://orcid.org/0000-0002-9358-6690Rebecca A Segravehttps://orcid.org/0000-0002-1839-0794Maja Brydevallhttps://orcid.org/0009-0007-7909-4570Rebecca Kirkhamhttps://orcid.org/0000-0002-3004-7219Chang Liuhttps://orcid.org/0000-0003-0324-8151Leonardo F Fontenellehttps://orcid.org/0000-0001-9075-8226Samuel R Chamberlainhttps://orcid.org/0000-0001-7014-8121Kristian Rotaruhttps://orcid.org/0000-0003-2570-2044Murat Yücelhttps://orcid.org/0000-0002-4705-452X BackgroundMany people with harmful addictive behaviors may not meet formal diagnostic thresholds for a disorder. A dimensional approach, by contrast, including clinical and community samples, is potentially key to early detection, prevention, and intervention. Importantly, while neurocognitive dysfunction underpins addictive behaviors, established assessment tools for neurocognitive assessment are lengthy and unengaging, difficult to administer at scale, and not suited to clinical or community needs. The BrainPark Assessment of Cognition (BrainPAC) Project sought to develop and validate an engaging and user-friendly digital assessment tool purpose-built to comprehensively assess the main consensus-driven constructs underpinning addictive behaviors. ObjectiveThe purpose of this study was to psychometrically validate a gamified battery of consensus-based neurocognitive tasks against standard laboratory paradigms, ascertain test-retest reliability, and determine their sensitivity to addictive behaviors (eg, alcohol use) and other risk factors (eg, trait impulsivity). MethodsGold standard laboratory paradigms were selected to measure key neurocognitive constructs (Balloon Analogue Risk Task [BART], Stop Signal Task [SST], Delay Discounting Task [DDT], Value-Modulated Attentional Capture [VMAC] Task, and Sequential Decision-Making Task [SDT]), as endorsed by an international panel of addiction experts; namely, response selection and inhibition, reward valuation, action selection, reward learning, expectancy and reward prediction error, habit, and compulsivity. Working with game developers, BrainPAC tasks were developed and validated in 3 successive cohorts (total N=600) and a separate test-retest cohort (N=50) via Mechanical Turk using a cross-sectional design. ResultsBrainPAC tasks were significantly correlated with the original laboratory paradigms on most metrics (r=0.18-0.63, P<.05). With the exception of the DDT k function and VMAC total points, all other task metrics across the 5 tasks did not differ between the gamified and nongamified versions (P>.05). Out of 5 tasks, 4 demonstrated adequate to excellent test-retest reliability (intraclass correlation coefficient 0.72-0.91, P<.001; except SDT). Gamified metrics were significantly associated with addictive behaviors on behavioral inventories, though largely independent of trait-based scales known to predict addiction risk. ConclusionsA purpose-built battery of digitally gamified tasks is sufficiently valid for the scalable assessment of key neurocognitive processes underpinning addictive behaviors. This validation provides evidence that a novel approach, purported to enhance task engagement, in the assessment of addiction-related neurocognition is feasible and empirically defensible. These findings have significant implications for risk detection and the successful deployment of next-generation assessment tools for substance use or misuse and other mental disorders characterized by neurocognitive anomalies related to motivation and self-regulation. Future development and validation of the BrainPAC tool should consider further enhancing convergence with established measures as well as collecting population-representative data to use clinically as normative comparisons.https://www.jmir.org/2023/1/e44414 |
| spellingShingle | Rico S C Lee Lucy Albertella Erynn Christensen Chao Suo Rebecca A Segrave Maja Brydevall Rebecca Kirkham Chang Liu Leonardo F Fontenelle Samuel R Chamberlain Kristian Rotaru Murat Yücel A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study Journal of Medical Internet Research |
| title | A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study |
| title_full | A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study |
| title_fullStr | A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study |
| title_full_unstemmed | A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study |
| title_short | A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study |
| title_sort | novel expert endorsed neurocognitive digital assessment tool for addictive disorders development and validation study |
| url | https://www.jmir.org/2023/1/e44414 |
| work_keys_str_mv | AT ricosclee anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT lucyalbertella anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT erynnchristensen anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT chaosuo anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT rebeccaasegrave anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT majabrydevall anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT rebeccakirkham anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT changliu anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT leonardoffontenelle anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT samuelrchamberlain anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT kristianrotaru anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT muratyucel anovelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT ricosclee novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT lucyalbertella novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT erynnchristensen novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT chaosuo novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT rebeccaasegrave novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT majabrydevall novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT rebeccakirkham novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT changliu novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT leonardoffontenelle novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT samuelrchamberlain novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT kristianrotaru novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy AT muratyucel novelexpertendorsedneurocognitivedigitalassessmenttoolforaddictivedisordersdevelopmentandvalidationstudy |