论文标题

基于模型的逆增强从视觉演示中学习

Model-Based Inverse Reinforcement Learning from Visual Demonstrations

论文作者

Das, Neha, Bechtle, Sarah, Davchev, Todor, Jayaraman, Dinesh, Rai, Akshara, Meier, Franziska

论文摘要

基于模型的逆增强学习(IRL)对具有未知动态的实际机器人操纵任务仍然是一个开放的问题。关键的挑战在于学习良好的动态模型,开发算法将扩展到高维状态空间,并能够从视觉和本体感受演示中学习。在这项工作中,我们提出了一个基于梯度的逆增强学习框架,该框架仅在仅给予视觉人类演示时就使用预训练的视觉动力学模型来学习成本功能。然后,通过视觉模型预测控制,使用了学习的成本功能来重现所证明的行为。我们在两个基本对象操纵任务上评估了硬件框架。

Scaling model-based inverse reinforcement learning (IRL) to real robotic manipulation tasks with unknown dynamics remains an open problem. The key challenges lie in learning good dynamics models, developing algorithms that scale to high-dimensional state-spaces and being able to learn from both visual and proprioceptive demonstrations. In this work, we present a gradient-based inverse reinforcement learning framework that utilizes a pre-trained visual dynamics model to learn cost functions when given only visual human demonstrations. The learned cost functions are then used to reproduce the demonstrated behavior via visual model predictive control. We evaluate our framework on hardware on two basic object manipulation tasks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源