论文标题
关于AI的可控性
On Controllability of AI
论文作者
论文摘要
预计人工通用情报的发明会导致人类文明轨迹的转变。为了获得收益并避免这种强大技术的陷阱，能够控制它很重要。但是，尚未正式建立控制人工智能及其更高级版本的可能性。在本文中，我们提出了来自多个领域的证据，表明无法完全控制高级AI。讨论了AI的不可控制性的后果，讨论了人类的未来和对AI的研究以及AI安全和保障的后果。
Invention of artificial general intelligence is predicted to cause a shift in the trajectory of human civilization. In order to reap the benefits and avoid pitfalls of such powerful technology it is important to be able to control it. However, possibility of controlling artificial general intelligence and its more advanced version, superintelligence, has not been formally established. In this paper, we present arguments as well as supporting evidence from multiple domains indicating that advanced AI can't be fully controlled. Consequences of uncontrollability of AI are discussed with respect to future of humanity and research on AI, and AI safety and security.
