Walking Stability Control Method for Biped Robot on Uneven Ground Based on Deep Q-Network |
| |
Authors: | Baoling Han Yuting Zhao and Qingsheng Luo |
| |
Affiliation: | School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China,School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100081, China and School of Mechatronic Engineering, Beijing Institute of Technology, Beijing 100081, China |
| |
Abstract: | A gait control method for a biped robot based on the deep Q-network (DQN) algorithm is proposed to enhance the stability of walking on uneven ground. This control strategy is an intelligent learning method of posture adjustment. A robot is taken as an agent and trained to walk steadily on an uneven surface with obstacles, using a simple reward function based on forward progress. The reward-punishment (RP) mechanism of the DQN algorithm is established after obtaining the offline gait which was generated in advance foot trajectory planning. Instead of implementing a complex dynamic model, the proposed method enables the biped robot to learn to adjust its posture on the uneven ground and ensures walking stability. The performance and effectiveness of the proposed algorithm was validated in the V-REP simulation environment. The results demonstrate that the biped robot''s lateral tile angle is less than 3° after implementing the proposed method and the walking stability is obviously improved. |
| |
Keywords: | deep Q-network (DQN) biped robot uneven ground walking stability gait control |
本文献已被 万方数据 等数据库收录! |
| 点击此处可从《北京理工大学学报(英文版)》浏览原始摘要信息 |
|
点击此处可从《北京理工大学学报(英文版)》下载全文 |