An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications

Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains challenging. Therefore, a novel framework for imitation learnin...

Full description

Bibliographic Details
Main Authors: Kazuki Hayashi, Sho Sakaino, Toshiaki Tsuji
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9722836/
_version_ 1818744913456529408
author Kazuki Hayashi
Sho Sakaino
Toshiaki Tsuji
author_facet Kazuki Hayashi
Sho Sakaino
Toshiaki Tsuji
author_sort Kazuki Hayashi
collection DOAJ
description Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains challenging. Therefore, a novel framework for imitation learning is proposed to solve this problem. The proposed framework comprises upper and lower layers, where the upper layer model, whose timescale is long, and lower layer model, whose timescale is short, can be independently trained. In this model, the upper layer learns long-term task planning, and the lower layer learns motion primitives. The proposed method was experimentally compared to hierarchical RNN-based methods to validate its effectiveness. Consequently, the proposed method showed a success rate equal to or greater than that of conventional methods. In addition, the proposed method required less than 1/20 of the training time compared to conventional methods. Moreover, it succeeded in executing unlearned tasks by reusing the trained lower layer.
first_indexed 2024-12-18T02:51:52Z
format Article
id doaj.art-477b69af12714acc8b3e1896a22f7016
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-18T02:51:52Z
publishDate 2022-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-477b69af12714acc8b3e1896a22f70162022-12-21T21:23:26ZengIEEEIEEE Access2169-35362022-01-0110327663278110.1109/ACCESS.2022.31552559722836An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning ApplicationsKazuki Hayashi0https://orcid.org/0000-0002-8367-8962Sho Sakaino1https://orcid.org/0000-0002-5182-5649Toshiaki Tsuji2https://orcid.org/0000-0002-4532-4514Faculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, JapanDepartment of Intelligent Interaction Technologies, University of Tsukuba, Tsukuba, JapanDepartment of Electrical and Electronic Systems, Saitama University, Saitama, JapanRecently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains challenging. Therefore, a novel framework for imitation learning is proposed to solve this problem. The proposed framework comprises upper and lower layers, where the upper layer model, whose timescale is long, and lower layer model, whose timescale is short, can be independently trained. In this model, the upper layer learns long-term task planning, and the lower layer learns motion primitives. The proposed method was experimentally compared to hierarchical RNN-based methods to validate its effectiveness. Consequently, the proposed method showed a success rate equal to or greater than that of conventional methods. In addition, the proposed method required less than 1/20 of the training time compared to conventional methods. Moreover, it succeeded in executing unlearned tasks by reusing the trained lower layer.https://ieeexplore.ieee.org/document/9722836/Bilateral controlimitation learningmotion planningrobot learning
spellingShingle Kazuki Hayashi
Sho Sakaino
Toshiaki Tsuji
An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications
IEEE Access
Bilateral control
imitation learning
motion planning
robot learning
title An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications
title_full An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications
title_fullStr An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications
title_full_unstemmed An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications
title_short An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications
title_sort independently learnable hierarchical model for bilateral control based imitation learning applications
topic Bilateral control
imitation learning
motion planning
robot learning
url https://ieeexplore.ieee.org/document/9722836/
work_keys_str_mv AT kazukihayashi anindependentlylearnablehierarchicalmodelforbilateralcontrolbasedimitationlearningapplications
AT shosakaino anindependentlylearnablehierarchicalmodelforbilateralcontrolbasedimitationlearningapplications
AT toshiakitsuji anindependentlylearnablehierarchicalmodelforbilateralcontrolbasedimitationlearningapplications
AT kazukihayashi independentlylearnablehierarchicalmodelforbilateralcontrolbasedimitationlearningapplications
AT shosakaino independentlylearnablehierarchicalmodelforbilateralcontrolbasedimitationlearningapplications
AT toshiakitsuji independentlylearnablehierarchicalmodelforbilateralcontrolbasedimitationlearningapplications