论文标题
TextWorldExpress:以每秒100万步的模拟文本游戏
TextWorldExpress: Simulating Text Games at One Million Steps Per Second
论文作者
论文摘要
基于文本的游戏提供了一个具有挑战性的测试床,可以通过语言理解,多步问题解决和常识性推理评估虚拟代理。但是,速度是当前基于文本的游戏的主要局限性,它以每秒300个步长限制,这主要是由于使用旧工具。在这项工作中,我们介绍了TextWorldExpress,这是一种高性能模拟器,其中包括三个常见文本游戏基准的实现,将模拟吞吐量增加了大约三个数量级,在常见的桌面硬件上每秒超过一百万步。这大大降低了实验运行时,大约有一天可以进行十亿步尺度的实验。
Text-based games offer a challenging test bed to evaluate virtual agents at language understanding, multi-step problem-solving, and common-sense reasoning. However, speed is a major limitation of current text-based games, capping at 300 steps per second, mainly due to the use of legacy tooling. In this work we present TextWorldExpress, a high-performance simulator that includes implementations of three common text game benchmarks that increases simulation throughput by approximately three orders of magnitude, reaching over one million steps per second on common desktop hardware. This significantly reduces experiment runtime, enabling billion-step-scale experiments in about one day.