Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation

Visual or haptic feedback based on error modulation has been used to improve the effect of robot-assisted rehabilitation training. However, there are several investigations on the effects of error modulation-based visual and haptic feedback fusion strategies on motor learning and motivation. To obse...

Full description

Bibliographic Details
Main Authors: Jingyan Meng, Na Li, Yang Hu, Dazheng Zhao, Guoning Li, Jingyan Hu, Tao Song, Yehao Ma, Rongzhen Fu, Guokun Zuo, Liang Tao, Min Tang, Yunfeng Liu, Changcheng Shi
Format: Article
Language:English
Published: Hindawi Limited 2023-01-01
Series:Applied Bionics and Biomechanics
Online Access:http://dx.doi.org/10.1155/2023/8974148
_version_ 1797771665283743744
author Jingyan Meng
Na Li
Yang Hu
Dazheng Zhao
Guoning Li
Jingyan Hu
Tao Song
Yehao Ma
Rongzhen Fu
Guokun Zuo
Liang Tao
Min Tang
Yunfeng Liu
Changcheng Shi
author_facet Jingyan Meng
Na Li
Yang Hu
Dazheng Zhao
Guoning Li
Jingyan Hu
Tao Song
Yehao Ma
Rongzhen Fu
Guokun Zuo
Liang Tao
Min Tang
Yunfeng Liu
Changcheng Shi
author_sort Jingyan Meng
collection DOAJ
description Visual or haptic feedback based on error modulation has been used to improve the effect of robot-assisted rehabilitation training. However, there are several investigations on the effects of error modulation-based visual and haptic feedback fusion strategies on motor learning and motivation. To observe the influence of different feedback fusion strategies on motor learning and motivation, a parallel controlled study was conducted, dividing 30 healthy subjects into three groups with similar skill levels. The no error modulation group received visual and haptic feedback without error modulation; the visual amplification haptic reduction group received visual error amplification combined with haptic error reduction, and the visual reduction haptic amplification (VRHA) group received visual error reduction combined with haptic error amplification. Each subject implemented a trajectory-tracking task with an upper limb rehabilitation robot. They went through baseline, training, assessment, and generalization tests and completed 340 consecutive tracking movements. To evaluate motor learning and motivation, the average tracking error, the root mean square (RMS) of surface electromyography (sEMG) signals, and the intrinsic motivation inventory scale were all examined. In the assessment tests, the average tracking error was significantly decreased in all three groups. In particular, the VRHA group had a larger reduction in average tracking error in the generalization test, lower RMS of sEMG signals both in the assessment and generalization tests and higher perceived competence in the assessment tests. The VRHA fusion strategy significantly improved the subjects’ motor learning and transfer ability, decreased muscle activation, and increased motor learning motivation. These findings may provide some new insights for multisensory feedback fusion technology in the application of rehabilitation robots.
first_indexed 2024-03-12T21:40:52Z
format Article
id doaj.art-e2531ef1d32e489e8fcfa68f675421ef
institution Directory Open Access Journal
issn 1754-2103
language English
last_indexed 2024-03-12T21:40:52Z
publishDate 2023-01-01
publisher Hindawi Limited
record_format Article
series Applied Bionics and Biomechanics
spelling doaj.art-e2531ef1d32e489e8fcfa68f675421ef2023-07-27T00:00:04ZengHindawi LimitedApplied Bionics and Biomechanics1754-21032023-01-01202310.1155/2023/8974148Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and MotivationJingyan Meng0Na Li1Yang Hu2Dazheng Zhao3Guoning Li4Jingyan Hu5Tao Song6Yehao Ma7Rongzhen Fu8Guokun Zuo9Liang Tao10Min Tang11Yunfeng Liu12Changcheng Shi13College of Mechanical EngineeringNingbo Institute of Materials Technology and EngineeringCollege of Mechanical EngineeringCollege of Mechanical EngineeringNingbo Institute of Materials Technology and EngineeringNingbo Institute of Materials Technology and EngineeringNingbo Institute of Materials Technology and EngineeringNingbo University of TechnologyNingbo Institute of Materials Technology and EngineeringNingbo Institute of Materials Technology and EngineeringNingbo Rehabilitation HospitalNingbo Rehabilitation HospitalCollege of Mechanical EngineeringNingbo Institute of Materials Technology and EngineeringVisual or haptic feedback based on error modulation has been used to improve the effect of robot-assisted rehabilitation training. However, there are several investigations on the effects of error modulation-based visual and haptic feedback fusion strategies on motor learning and motivation. To observe the influence of different feedback fusion strategies on motor learning and motivation, a parallel controlled study was conducted, dividing 30 healthy subjects into three groups with similar skill levels. The no error modulation group received visual and haptic feedback without error modulation; the visual amplification haptic reduction group received visual error amplification combined with haptic error reduction, and the visual reduction haptic amplification (VRHA) group received visual error reduction combined with haptic error amplification. Each subject implemented a trajectory-tracking task with an upper limb rehabilitation robot. They went through baseline, training, assessment, and generalization tests and completed 340 consecutive tracking movements. To evaluate motor learning and motivation, the average tracking error, the root mean square (RMS) of surface electromyography (sEMG) signals, and the intrinsic motivation inventory scale were all examined. In the assessment tests, the average tracking error was significantly decreased in all three groups. In particular, the VRHA group had a larger reduction in average tracking error in the generalization test, lower RMS of sEMG signals both in the assessment and generalization tests and higher perceived competence in the assessment tests. The VRHA fusion strategy significantly improved the subjects’ motor learning and transfer ability, decreased muscle activation, and increased motor learning motivation. These findings may provide some new insights for multisensory feedback fusion technology in the application of rehabilitation robots.http://dx.doi.org/10.1155/2023/8974148
spellingShingle Jingyan Meng
Na Li
Yang Hu
Dazheng Zhao
Guoning Li
Jingyan Hu
Tao Song
Yehao Ma
Rongzhen Fu
Guokun Zuo
Liang Tao
Min Tang
Yunfeng Liu
Changcheng Shi
Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation
Applied Bionics and Biomechanics
title Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation
title_full Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation
title_fullStr Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation
title_full_unstemmed Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation
title_short Effects of Error Modulation-Based Visual and Haptic Feedback Fusion Strategies on Motor Learning and Motivation
title_sort effects of error modulation based visual and haptic feedback fusion strategies on motor learning and motivation
url http://dx.doi.org/10.1155/2023/8974148
work_keys_str_mv AT jingyanmeng effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT nali effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT yanghu effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT dazhengzhao effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT guoningli effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT jingyanhu effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT taosong effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT yehaoma effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT rongzhenfu effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT guokunzuo effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT liangtao effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT mintang effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT yunfengliu effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation
AT changchengshi effectsoferrormodulationbasedvisualandhapticfeedbackfusionstrategiesonmotorlearningandmotivation