论文标题
在创建安全的开放式AI：控制与创造力之间的紧张局势时开放问题
Open Questions in Creating Safe Open-ended AI: Tensions Between Control and Creativity
论文作者
论文摘要
人工生命起源于长期以来研究开放式进化的话题，该主题寻求受生物进化的启发的人工系统的基础原理。最近，在开放式进化的概括中，兴趣在更广泛的AI领域中增长了，这里称为开放式搜索，其中探索了这种开放性问题以推进AI，无论基本搜索算法的性质是什么（例如，基于进化的或基于梯度的）。例如，开放式搜索可能会为神经网络，新的强化学习算法或最雄心勃勃的旨在设计新的体系结构，旨在设计人工通用智能。本文提出，开放式的进化和人造生活有很大的贡献，有助于对开放式AI的理解，尤其是在这里，尤其是开放式搜索的安全。这个想法是，AI系统越来越多地应用于现实世界，通常会在此过程中造成意外危害，从而激发了人工智能安全的不断增长。本文认为，开放式AI特别是其安全挑战，特别是开放式系统的创造力是否可以有效地受到可预测的控制。本文解释了开放式搜索中独特的安全问题如何表现出来，并提出了具体的贡献和研究问题以探索它们。希望是激发朝着创造性，有用和安全的开放式搜索算法的进步。
Artificial life originated and has long studied the topic of open-ended evolution, which seeks the principles underlying artificial systems that innovate continually, inspired by biological evolution. Recently, interest has grown within the broader field of AI in a generalization of open-ended evolution, here called open-ended search, wherein such questions of open-endedness are explored for advancing AI, whatever the nature of the underlying search algorithm (e.g. evolutionary or gradient-based). For example, open-ended search might design new architectures for neural networks, new reinforcement learning algorithms, or most ambitiously, aim at designing artificial general intelligence. This paper proposes that open-ended evolution and artificial life have much to contribute towards the understanding of open-ended AI, focusing here in particular on the safety of open-ended search. The idea is that AI systems are increasingly applied in the real world, often producing unintended harms in the process, which motivates the growing field of AI safety. This paper argues that open-ended AI has its own safety challenges, in particular, whether the creativity of open-ended systems can be productively and predictably controlled. This paper explains how unique safety problems manifest in open-ended search, and suggests concrete contributions and research questions to explore them. The hope is to inspire progress towards creative, useful, and safe open-ended search algorithms.
