Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing

Image therapy, which creates illusions with a mirror and a head mount display, assists movement relearning in stroke patients. Mirror therapy presents the movement of the unaffected limb in a mirror, creating the illusion of movement of the affected limb. As the visual information of images cannot c...

Full description

Bibliographic Details
Main Authors: Takumi Okumura, Yuichi Kurita
Format: Article
Language:English
Published: MDPI AG 2021-03-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/11/7/2987
_version_ 1797539916595331072
author Takumi Okumura
Yuichi Kurita
author_facet Takumi Okumura
Yuichi Kurita
author_sort Takumi Okumura
collection DOAJ
description Image therapy, which creates illusions with a mirror and a head mount display, assists movement relearning in stroke patients. Mirror therapy presents the movement of the unaffected limb in a mirror, creating the illusion of movement of the affected limb. As the visual information of images cannot create a fully immersive experience, we propose a cross-modal strategy that supplements the image with sensual information. By interacting with the stimuli received from multiple sensory organs, the brain complements missing senses, and the patient experiences a different sense of motion. Our system generates the sense of stair-climbing in a subject walking on a level floor. The force sensation is presented by a pneumatic gel muscle (PGM). Based on motion analysis in a human lower-limb model and the characteristics of the force exerted by the PGM, we set the appropriate air pressure of the PGM. The effectiveness of the proposed system was evaluated by surface electromyography and a questionnaire. The experimental results showed that by synchronizing the force sensation with visual information, we could match the motor and perceived sensations at the muscle-activity level, enhancing the sense of stair-climbing. The experimental results showed that the visual condition significantly improved the illusion intensity during stair-climbing.
first_indexed 2024-03-10T12:52:37Z
format Article
id doaj.art-cc693266d5ad47abb1008c35e08b92f3
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T12:52:37Z
publishDate 2021-03-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-cc693266d5ad47abb1008c35e08b92f32023-11-21T12:11:56ZengMDPI AGApplied Sciences2076-34172021-03-01117298710.3390/app11072987Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-ClimbingTakumi Okumura0Yuichi Kurita1Graduate School of Advanced Science and Engineering, Hiroshima University, Hiroshima 739-8527, JapanGraduate School of Advanced Science and Engineering, Hiroshima University, Hiroshima 739-8527, JapanImage therapy, which creates illusions with a mirror and a head mount display, assists movement relearning in stroke patients. Mirror therapy presents the movement of the unaffected limb in a mirror, creating the illusion of movement of the affected limb. As the visual information of images cannot create a fully immersive experience, we propose a cross-modal strategy that supplements the image with sensual information. By interacting with the stimuli received from multiple sensory organs, the brain complements missing senses, and the patient experiences a different sense of motion. Our system generates the sense of stair-climbing in a subject walking on a level floor. The force sensation is presented by a pneumatic gel muscle (PGM). Based on motion analysis in a human lower-limb model and the characteristics of the force exerted by the PGM, we set the appropriate air pressure of the PGM. The effectiveness of the proposed system was evaluated by surface electromyography and a questionnaire. The experimental results showed that by synchronizing the force sensation with visual information, we could match the motor and perceived sensations at the muscle-activity level, enhancing the sense of stair-climbing. The experimental results showed that the visual condition significantly improved the illusion intensity during stair-climbing.https://www.mdpi.com/2076-3417/11/7/2987virtual realitystairscross-modalsense of musclepneumatic artificial muscle
spellingShingle Takumi Okumura
Yuichi Kurita
Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing
Applied Sciences
virtual reality
stairs
cross-modal
sense of muscle
pneumatic artificial muscle
title Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing
title_full Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing
title_fullStr Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing
title_full_unstemmed Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing
title_short Cross-Modal Effect of Presenting Visual and Force Feedback That Create the Illusion of Stair-Climbing
title_sort cross modal effect of presenting visual and force feedback that create the illusion of stair climbing
topic virtual reality
stairs
cross-modal
sense of muscle
pneumatic artificial muscle
url https://www.mdpi.com/2076-3417/11/7/2987
work_keys_str_mv AT takumiokumura crossmodaleffectofpresentingvisualandforcefeedbackthatcreatetheillusionofstairclimbing
AT yuichikurita crossmodaleffectofpresentingvisualandforcefeedbackthatcreatetheillusionofstairclimbing