Force Myography-Based Human Robot Interactions via Deep Domain Adaptation and Generalization

Estimating applied force using force myography (FMG) technique can be effective in human-robot interactions (HRI) using data-driven models. A model predicts well when adequate training and evaluation are observed in same session, which is sometimes time consuming and impractical. In real scenarios,...

Full description

Bibliographic Details
Main Authors: Umme Zakia, Carlo Menon
Format: Article
Language:English
Published: MDPI AG 2021-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/1/211
Description
Summary:Estimating applied force using force myography (FMG) technique can be effective in human-robot interactions (HRI) using data-driven models. A model predicts well when adequate training and evaluation are observed in same session, which is sometimes time consuming and impractical. In real scenarios, a pretrained transfer learning model predicting forces quickly once fine-tuned to target distribution would be a favorable choice and hence needs to be examined. Therefore, in this study a unified supervised FMG-based deep transfer learner (SFMG-DTL) model using CNN architecture was pretrained with multiple sessions FMG source data (D<sub>s</sub>, T<sub>s</sub>) and evaluated in estimating forces in separate target domains (D<sub>t</sub>, T<sub>t</sub>) via supervised domain adaptation (SDA) and supervised domain generalization (SDG). For SDA, case (i) intra-subject evaluation (D<sub>s</sub> ≠ D<sub>t-SDA</sub>, T<sub>s</sub> ≈ T<sub>t-SDA</sub>) was examined, while for SDG, case (ii) cross-subject evaluation (D<sub>s</sub> ≠ D<sub>t-SDG</sub>, T<sub>s</sub> ≠ T<sub>t-SDG</sub>) was examined. Fine tuning with few “target training data” calibrated the model effectively towards target adaptation. The proposed SFMG-DTL model performed better with higher estimation accuracies and lower errors (R<sup>2</sup> ≥ 88%, NRMSE ≤ 0.6) in both cases. These results reveal that interactive force estimations via transfer learning will improve daily HRI experiences where “target training data” is limited, or faster adaptation is required.
ISSN:1424-8220