Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review
BackgroundNeuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-02-01
|
| Series: | JMIR Serious Games |
| Online Access: | https://games.jmir.org/2024/1/e50282 |
| _version_ | 1797294633880911872 |
|---|---|
| author | Rebecca Kirkham Lars Kooijman Lucy Albertella Dan Myles Murat Yücel Kristian Rotaru |
| author_facet | Rebecca Kirkham Lars Kooijman Lucy Albertella Dan Myles Murat Yücel Kristian Rotaru |
| author_sort | Rebecca Kirkham |
| collection | DOAJ |
| description |
BackgroundNeuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)–based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility.
ObjectiveThis systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects.
MethodsEBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings.
ResultsThe search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments.
ConclusionsAlthough it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications. |
| first_indexed | 2024-03-07T21:34:03Z |
| format | Article |
| id | doaj.art-d09c0950b6b14cf28b227e3f4445c8b3 |
| institution | Directory Open Access Journal |
| issn | 2291-9279 |
| language | English |
| last_indexed | 2024-03-07T21:34:03Z |
| publishDate | 2024-02-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Serious Games |
| spelling | doaj.art-d09c0950b6b14cf28b227e3f4445c8b32024-02-26T14:45:56ZengJMIR PublicationsJMIR Serious Games2291-92792024-02-0112e5028210.2196/50282Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic ReviewRebecca Kirkhamhttps://orcid.org/0000-0002-3004-7219Lars Kooijmanhttps://orcid.org/0000-0002-0902-5752Lucy Albertellahttps://orcid.org/0000-0001-5232-6414Dan Myleshttps://orcid.org/0000-0002-0378-7027Murat Yücelhttps://orcid.org/0000-0002-4705-452XKristian Rotaruhttps://orcid.org/0000-0003-2570-2044 BackgroundNeuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)–based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility. ObjectiveThis systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects. MethodsEBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings. ResultsThe search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments. ConclusionsAlthough it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications.https://games.jmir.org/2024/1/e50282 |
| spellingShingle | Rebecca Kirkham Lars Kooijman Lucy Albertella Dan Myles Murat Yücel Kristian Rotaru Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review JMIR Serious Games |
| title | Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review |
| title_full | Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review |
| title_fullStr | Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review |
| title_full_unstemmed | Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review |
| title_short | Immersive Virtual Reality–Based Methods for Assessing Executive Functioning: Systematic Review |
| title_sort | immersive virtual reality based methods for assessing executive functioning systematic review |
| url | https://games.jmir.org/2024/1/e50282 |
| work_keys_str_mv | AT rebeccakirkham immersivevirtualrealitybasedmethodsforassessingexecutivefunctioningsystematicreview AT larskooijman immersivevirtualrealitybasedmethodsforassessingexecutivefunctioningsystematicreview AT lucyalbertella immersivevirtualrealitybasedmethodsforassessingexecutivefunctioningsystematicreview AT danmyles immersivevirtualrealitybasedmethodsforassessingexecutivefunctioningsystematicreview AT muratyucel immersivevirtualrealitybasedmethodsforassessingexecutivefunctioningsystematicreview AT kristianrotaru immersivevirtualrealitybasedmethodsforassessingexecutivefunctioningsystematicreview |