跳到主要导航 跳到搜索 跳到主要内容

MLM: Learning Multi-Task Loco-Manipulation Whole-Body Control for Quadruped Robot with Arm

  • Xin Liu
  • , Bida Ma
  • , Chenkun Qi
  • , Yan Ding
  • , Nuo Xu
  • , Zhaxizhuoma
  • , Guorong Zhang
  • , Pengan Chen
  • , Kehui Liu
  • , Zhongjie Jia
  • , Chuyue Guan
  • , Yule Mo
  • , Jiaqi Liu
  • , Feng Gao
  • , Jiangwei Zhong
  • , Bin Zhao
  • , Xuelong Li
  • Shanghai Jiao Tong University
  • Shanghai Artificial Intelligence Laboratory
  • Lenovo
  • China Telecommunications

科研成果: 期刊稿件 › 文章 › 同行评审

5 引用 (Scopus)

摘要

Whole-body loco-manipulation for quadruped robots with arms remains a challenging problem, particularly in achieving multi-task control. To address this, we propose MLM, a reinforcement learning framework driven by both real-world and simulation data. It enables a six-DoF robotic arm-equipped quadruped robot to perform whole-body loco-manipulation for multiple tasks autonomously or under human teleoperation. To address the problem of balancing multiple tasks during the learning of loco-manipulation, we introduce a trajectory library with an adaptive, curriculum-based sampling mechanism. This approach allows the policy to efficiently leverage real-world collected trajectories for learning multi-task loco-manipulation. To address deployment scenarios with only historical observations and to enhance the performance of policy execution across tasks with different spatial ranges, we propose a Trajectory-Velocity Prediction policy network. It predicts unobservable future trajectories and velocities. By leveraging extensive simulation data and curriculum-based rewards, our controller achieves whole-body behaviors in simulation and zero-shot transfer to real-world deployment. Ablation studies in simulation verify the necessity and effectiveness of our approach, while real-world experiments on a Go2 robot with an Airbot robotic arm demonstrate the policy's good performance in multi-task execution.

源语言英语
页(从-至)81-88
页数8
期刊IEEE Robotics and Automation Letters
卷11
期1
DOI
出版状态已出版 - 2026
已对外发布是

学术指纹

探究 'MLM: Learning Multi-Task Loco-Manipulation Whole-Body Control for Quadruped Robot with Arm' 的科研主题。它们共同构成独一无二的学术指纹。

引用此