Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study

Abstract Background Robotic therapy and serious gaming support motor learning in neurorehabilitation. Traditional monitor-based gaming outputs cannot adequately represent the third dimension, whereas virtual reality headsets lack the connection to the real world. The use of Augmented Reality (AR) te...

Full description

Bibliographic Details
Main Authors: Alexandra Charlotte de Crignis, Salome-Thamar Ruhnau, Matthias Hösl, Jérémy Lefint, Tamara Amberger, Jürgen Dressnandt, Hans Brunner, Friedemann Müller
Format: Article
Language:English
Published: BMC 2023-08-01
Series:Journal of NeuroEngineering and Rehabilitation
Subjects:
Online Access:https://doi.org/10.1186/s12984-023-01225-5
_version_ 1827635312411541504
author Alexandra Charlotte de Crignis
Salome-Thamar Ruhnau
Matthias Hösl
Jérémy Lefint
Tamara Amberger
Jürgen Dressnandt
Hans Brunner
Friedemann Müller
author_facet Alexandra Charlotte de Crignis
Salome-Thamar Ruhnau
Matthias Hösl
Jérémy Lefint
Tamara Amberger
Jürgen Dressnandt
Hans Brunner
Friedemann Müller
author_sort Alexandra Charlotte de Crignis
collection DOAJ
description Abstract Background Robotic therapy and serious gaming support motor learning in neurorehabilitation. Traditional monitor-based gaming outputs cannot adequately represent the third dimension, whereas virtual reality headsets lack the connection to the real world. The use of Augmented Reality (AR) techniques could potentially overcome these issues. The objective of this study was thus to evaluate the usability, feasibility and functionality of a novel arm rehabilitation device for neurorehabilitation (RobExReha system) based on a robotic arm (LBR iiwa, KUKA AG) and serious gaming using the AR headset HoloLens (Microsoft Inc.). Methods The RobExReha system was tested with eleven adult inpatients (mean age: 64.4 ± 11.2 years; diagnoses: 8 stroke, 2 spinal cord injury, 1 Guillain-Barré-Syndrome) who had paretic impairments in their upper limb. Five therapists administered and evaluated the system. Data was compared with a Reference Group (eleven inpatients; mean age: 64.3 ± 9.1 years; diagnoses: 10 stroke, 1 spinal cord injury) who trained with commercially available robotic therapy devices (ArmeoPower or ArmeoSpring, Hocoma AG). Patients used standardized questionnaires for evaluating usability and comfort (Quebec User Evaluation of Satisfaction with assistive technology [QUEST]), workload (Raw Task Load Index [RTLX]) and a questionnaire for rating visual perception of the gaming scenario. Therapists used the QUEST, the System Usability Scale and the short version of the User Experience Questionnaire. Results Therapy with the RobExReha system was safe and feasible for patients and therapists, with no serious adverse events being reported. Patients and therapists were generally satisfied with usability. The patients’ usability ratings were significantly higher in the Reference Group for two items of the QUEST: reliability and ease of use. Workload (RTLX) ratings did not differ significantly between the groups. Nearly all patients using the RobExReha system perceived the gaming scenario in AR as functioning adequately despite eight patients having impairments in stereoscopic vision. The therapists valued the system’s approach as interesting and inventive. Conclusions We demonstrated the clinical feasibility of combining a novel robotic upper limb robot with an AR-serious game in a neurorehabilitation setting. To ensure high usability in future applications, a reliable and easy-to-use system that can be used for task-oriented training should be implemented. Trial registration Ethical approval was obtained and the trial was registered at the German Clinical Trials Register (DRKS00022136).
first_indexed 2024-03-09T15:26:01Z
format Article
id doaj.art-1b22b98791ce4cf0bffc79c28bf0cf6d
institution Directory Open Access Journal
issn 1743-0003
language English
last_indexed 2024-03-09T15:26:01Z
publishDate 2023-08-01
publisher BMC
record_format Article
series Journal of NeuroEngineering and Rehabilitation
spelling doaj.art-1b22b98791ce4cf0bffc79c28bf0cf6d2023-11-26T12:32:27ZengBMCJournal of NeuroEngineering and Rehabilitation1743-00032023-08-0120111410.1186/s12984-023-01225-5Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility studyAlexandra Charlotte de Crignis0Salome-Thamar Ruhnau1Matthias Hösl2Jérémy Lefint3Tamara Amberger4Jürgen Dressnandt5Hans Brunner6Friedemann Müller7Schön Klinik Bad AiblingBEC GmbHSchön Klinik Bad AiblingFraunhofer Institute for Manufacturing, Engineering and Automation IPASchön Klinik Bad AiblingSchön Klinik Bad AiblingSchön Klinik Bad AiblingSchön Klinik Bad AiblingAbstract Background Robotic therapy and serious gaming support motor learning in neurorehabilitation. Traditional monitor-based gaming outputs cannot adequately represent the third dimension, whereas virtual reality headsets lack the connection to the real world. The use of Augmented Reality (AR) techniques could potentially overcome these issues. The objective of this study was thus to evaluate the usability, feasibility and functionality of a novel arm rehabilitation device for neurorehabilitation (RobExReha system) based on a robotic arm (LBR iiwa, KUKA AG) and serious gaming using the AR headset HoloLens (Microsoft Inc.). Methods The RobExReha system was tested with eleven adult inpatients (mean age: 64.4 ± 11.2 years; diagnoses: 8 stroke, 2 spinal cord injury, 1 Guillain-Barré-Syndrome) who had paretic impairments in their upper limb. Five therapists administered and evaluated the system. Data was compared with a Reference Group (eleven inpatients; mean age: 64.3 ± 9.1 years; diagnoses: 10 stroke, 1 spinal cord injury) who trained with commercially available robotic therapy devices (ArmeoPower or ArmeoSpring, Hocoma AG). Patients used standardized questionnaires for evaluating usability and comfort (Quebec User Evaluation of Satisfaction with assistive technology [QUEST]), workload (Raw Task Load Index [RTLX]) and a questionnaire for rating visual perception of the gaming scenario. Therapists used the QUEST, the System Usability Scale and the short version of the User Experience Questionnaire. Results Therapy with the RobExReha system was safe and feasible for patients and therapists, with no serious adverse events being reported. Patients and therapists were generally satisfied with usability. The patients’ usability ratings were significantly higher in the Reference Group for two items of the QUEST: reliability and ease of use. Workload (RTLX) ratings did not differ significantly between the groups. Nearly all patients using the RobExReha system perceived the gaming scenario in AR as functioning adequately despite eight patients having impairments in stereoscopic vision. The therapists valued the system’s approach as interesting and inventive. Conclusions We demonstrated the clinical feasibility of combining a novel robotic upper limb robot with an AR-serious game in a neurorehabilitation setting. To ensure high usability in future applications, a reliable and easy-to-use system that can be used for task-oriented training should be implemented. Trial registration Ethical approval was obtained and the trial was registered at the German Clinical Trials Register (DRKS00022136).https://doi.org/10.1186/s12984-023-01225-5Augmented realityVirtual realityActive video gamingStrokeNeurorehabilitationRobotic therapy
spellingShingle Alexandra Charlotte de Crignis
Salome-Thamar Ruhnau
Matthias Hösl
Jérémy Lefint
Tamara Amberger
Jürgen Dressnandt
Hans Brunner
Friedemann Müller
Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study
Journal of NeuroEngineering and Rehabilitation
Augmented reality
Virtual reality
Active video gaming
Stroke
Neurorehabilitation
Robotic therapy
title Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study
title_full Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study
title_fullStr Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study
title_full_unstemmed Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study
title_short Robotic arm training in neurorehabilitation enhanced by augmented reality – a usability and feasibility study
title_sort robotic arm training in neurorehabilitation enhanced by augmented reality a usability and feasibility study
topic Augmented reality
Virtual reality
Active video gaming
Stroke
Neurorehabilitation
Robotic therapy
url https://doi.org/10.1186/s12984-023-01225-5
work_keys_str_mv AT alexandracharlottedecrignis roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT salomethamarruhnau roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT matthiashosl roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT jeremylefint roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT tamaraamberger roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT jurgendressnandt roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT hansbrunner roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy
AT friedemannmuller roboticarmtraininginneurorehabilitationenhancedbyaugmentedrealityausabilityandfeasibilitystudy