Q-Learning of Straightforward Gait Pattern for Humanoid Robot Based on Automatic Training Platform

In this paper, an oscillator-based gait pattern with sinusoidal functions is designed and implemented on a field-programmable gate array (FPGA) chip to generate a trajectory plan and achieve bipedal locomotion for a small-sized humanoid robot. In order to let the robot can walk straight, the turning...

Full description

Bibliographic Details
Main Authors: Ching-Chang Wong, Chih-Cheng Liu, Sheng-Ru Xiao, Hao-Yu Yang, Meng-Cheng Lau
Format: Article
Language:English
Published: MDPI AG 2019-05-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/8/6/615
Description
Summary:In this paper, an oscillator-based gait pattern with sinusoidal functions is designed and implemented on a field-programmable gate array (FPGA) chip to generate a trajectory plan and achieve bipedal locomotion for a small-sized humanoid robot. In order to let the robot can walk straight, the turning direction is viewed as a parameter of the gait pattern and Q-learning is used to obtain a straightforward gait pattern. Moreover, an automatic training platform is designed so that the learning process is automated. In this way, the turning direction can be adjusted flexibly and efficiently under the supervision of the automatic training platform. The experimental results show that the proposed learning framework allows the humanoid robot to gradually walk straight in the automated learning process.
ISSN:2079-9292