首页|A learning-based control pipeline for generic motor skills for quadruped robots

A learning-based control pipeline for generic motor skills for quadruped robots

扫码查看
原文链接
  • NETL
  • NSTL
  • 万方数据
Performing diverse motor skills with a universal controller has been a longstanding challenge for legged robots.While motion imitation-based reinforcement learning(RL)has shown remarkable performance in reproducing designed motor skills,the trained controller is only suitable for one specific type of motion.Motion synthesis has been well developed to generate a variety of different motions for character animation,but those motions only contain kinematic information and cannot be used for control.In this study,we introduce a control pipeline combining motion synthesis and motion imitation-based RL for generic motor skills.We design an animation state machine to synthesize motion from various sources and feed the generated kinematic reference trajectory to the RL controller as part of the input.With the proposed method,we show that a single policy is able to learn various motor skills simultaneously.Further,we notice the ability of the policy to uncover the correlations lurking behind the reference motions to improve control performance.We analyze this ability based on the predictability of the reference trajectory and use the quantified measurements to optimize the design of the controller.To demonstrate the effectiveness of our method,we deploy the trained policy on hardware and,with a single control policy,the quadruped robot can perform various learned skills,including automatic gait transitions,high kick,and forward jump.

Quadruped robotReinforcement learning(RL)Motion synthesisControl

Yecheng SHAO、Yongbin JIN、Zhilong HUANG、Hongtao WANG、Wei YANG

展开 >

Center for X-Mechanics,Zhejiang University,Hangzhou 310027,China

ZJU-Hangzhou Global Scientific and Technological Innovation Center,Hangzhou 311200,China

Institute of Applied Mechanics,Zhejiang University,Hangzhou 310027,China

State Key Laboratory of Fluid Power&Mechatronic Systems,Zhejiang University,Hangzhou 310058,China

展开 >

国家自然科学基金

12132013

2024

10.1631/jzus.A2300128

浙江大学学报(英文版)(A辑:应用物理和工程)
浙江大学

浙江大学学报(英文版)(A辑:应用物理和工程)

CSTPCD
影响因子：0.556
ISSN：1673-565X
年,卷(期)：2024.25(6)
  • 32