论文标题

机器人 - 一种开源工具包

robo-gym -- An Open Source Toolkit for Distributed Deep Reinforcement Learning on Real and Simulated Robots

论文作者

Lucchi, Matteo, Zindler, Friedemann, Mühlbacher-Karrer, Stephan, Pichler, Horst

论文摘要

在机器人技术领域中,将深入的加固学习(DRL)应用于复杂的任务,在近年来已经非常成功。但是,大多数出版物要么着重于将其应用于模拟任务,要么将其应用于现实世界设置中的任务。尽管有一个很好的例子,可以在转移学习的帮助下结合两个世界,但通常需要许多其他工作和微调才能使设置有效地工作。为了将DRL与真实机器人增加使用并减少模拟和现实世界机器人之间的差距,我们提出了一个开源工具包:Robo-Gym。我们展示了用于仿真和真实环境的统一设置,该设置可以从模拟中的训练到机器人的应用。我们展示了该框架的功能和有效性,其中包括工业机器人的两个现实世界应用:移动机器人和一个机器人部门。该框架的分布式功能可以实现多个优点,例如使用分布式算法,将模拟和培训的工作量分开,并使未来的机会同时培训模拟和现实世界。最后,我们提供了Robo-Gym与其他常用的最先进的DRL框架的概述和比较。

Applying Deep Reinforcement Learning (DRL) to complex tasks in the field of robotics has proven to be very successful in the recent years. However, most of the publications focus either on applying it to a task in simulation or to a task in a real world setup. Although there are great examples of combining the two worlds with the help of transfer learning, it often requires a lot of additional work and fine-tuning to make the setup work effectively. In order to increase the use of DRL with real robots and reduce the gap between simulation and real world robotics, we propose an open source toolkit: robo-gym. We demonstrate a unified setup for simulation and real environments which enables a seamless transfer from training in simulation to application on the robot. We showcase the capabilities and the effectiveness of the framework with two real world applications featuring industrial robots: a mobile robot and a robot arm. The distributed capabilities of the framework enable several advantages like using distributed algorithms, separating the workload of simulation and training on different physical machines as well as enabling the future opportunity to train in simulation and real world at the same time. Finally we offer an overview and comparison of robo-gym with other frequently used state-of-the-art DRL frameworks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源