Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality

The steady increase in the aging population worldwide is expected to cause a shortage of doctors and therapists for older people. This demographic shift requires more efficient and automated systems for rehabilitation and physical ability evaluations. Rehabilitation using mixed reality (MR) technolo...

Full description

Bibliographic Details
Main Authors: Kenya Tada, Yuhei Sorimachi, Kyo Kutsuzawa, Dai Owaki, Mitsuhiro Hayashibe
Format: Article
Language:English
Published: MDPI AG 2024-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/24/2/528
_version_ 1797339391380684800
author Kenya Tada
Yuhei Sorimachi
Kyo Kutsuzawa
Dai Owaki
Mitsuhiro Hayashibe
author_facet Kenya Tada
Yuhei Sorimachi
Kyo Kutsuzawa
Dai Owaki
Mitsuhiro Hayashibe
author_sort Kenya Tada
collection DOAJ
description The steady increase in the aging population worldwide is expected to cause a shortage of doctors and therapists for older people. This demographic shift requires more efficient and automated systems for rehabilitation and physical ability evaluations. Rehabilitation using mixed reality (MR) technology has attracted much attention in recent years. MR displays virtual objects on a head-mounted see-through display that overlies the user’s field of vision and allows users to manipulate them as if they exist in reality. However, tasks in previous studies applying MR to rehabilitation have been limited to tasks in which the virtual objects are static and do not interact dynamically with the surrounding environment. Therefore, in this study, we developed an application to evaluate cognitive and motor functions with the aim of realizing a rehabilitation system that is dynamic and has interaction with the surrounding environment using MR technology. The developed application enabled effective evaluation of the user’s spatial cognitive ability, task skillfulness, motor function, and decision-making ability. The results indicate the usefulness and feasibility of MR technology to quantify motor function and spatial cognition both for static and dynamic tasks in rehabilitation.
first_indexed 2024-03-08T09:46:18Z
format Article
id doaj.art-1c282a5cbdde45b0b13f16c796013926
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-08T09:46:18Z
publishDate 2024-01-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-1c282a5cbdde45b0b13f16c7960139262024-01-29T14:15:56ZengMDPI AGSensors1424-82202024-01-0124252810.3390/s24020528Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed RealityKenya Tada0Yuhei Sorimachi1Kyo Kutsuzawa2Dai Owaki3Mitsuhiro Hayashibe4Neuro-Robotics Lab, Department of Robotics, Graduate School of Engineering and also with Graduate School of Biomedical Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering and also with Graduate School of Biomedical Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering and also with Graduate School of Biomedical Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering and also with Graduate School of Biomedical Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering and also with Graduate School of Biomedical Engineering, Tohoku University, Sendai 980-8579, JapanThe steady increase in the aging population worldwide is expected to cause a shortage of doctors and therapists for older people. This demographic shift requires more efficient and automated systems for rehabilitation and physical ability evaluations. Rehabilitation using mixed reality (MR) technology has attracted much attention in recent years. MR displays virtual objects on a head-mounted see-through display that overlies the user’s field of vision and allows users to manipulate them as if they exist in reality. However, tasks in previous studies applying MR to rehabilitation have been limited to tasks in which the virtual objects are static and do not interact dynamically with the surrounding environment. Therefore, in this study, we developed an application to evaluate cognitive and motor functions with the aim of realizing a rehabilitation system that is dynamic and has interaction with the surrounding environment using MR technology. The developed application enabled effective evaluation of the user’s spatial cognitive ability, task skillfulness, motor function, and decision-making ability. The results indicate the usefulness and feasibility of MR technology to quantify motor function and spatial cognition both for static and dynamic tasks in rehabilitation.https://www.mdpi.com/1424-8220/24/2/528mixed realityHoloLens2game-based rehabilitationcognitive abilitymotor function
spellingShingle Kenya Tada
Yuhei Sorimachi
Kyo Kutsuzawa
Dai Owaki
Mitsuhiro Hayashibe
Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality
Sensors
mixed reality
HoloLens2
game-based rehabilitation
cognitive ability
motor function
title Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality
title_full Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality
title_fullStr Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality
title_full_unstemmed Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality
title_short Integrated Quantitative Evaluation of Spatial Cognition and Motor Function with HoloLens Mixed Reality
title_sort integrated quantitative evaluation of spatial cognition and motor function with hololens mixed reality
topic mixed reality
HoloLens2
game-based rehabilitation
cognitive ability
motor function
url https://www.mdpi.com/1424-8220/24/2/528
work_keys_str_mv AT kenyatada integratedquantitativeevaluationofspatialcognitionandmotorfunctionwithhololensmixedreality
AT yuheisorimachi integratedquantitativeevaluationofspatialcognitionandmotorfunctionwithhololensmixedreality
AT kyokutsuzawa integratedquantitativeevaluationofspatialcognitionandmotorfunctionwithhololensmixedreality
AT daiowaki integratedquantitativeevaluationofspatialcognitionandmotorfunctionwithhololensmixedreality
AT mitsuhirohayashibe integratedquantitativeevaluationofspatialcognitionandmotorfunctionwithhololensmixedreality