论文标题
关于主动推理和控制之间的关系
On the Relationship Between Active Inference and Control as Inference
论文作者
论文摘要
主动推理（AIF）是脑科学中的新兴框架，表明生物学作用是最大程度地减少对模型证据的差异结合的。 Control-As-推断（CAI）是增强学习中的框架，将决策作为变异的推断问题。尽管这些框架都考虑了通过变异推断的角度选择行动选择，但它们的关系仍不清楚。在这里，我们提供了它们之间的正式比较，并证明了主要差异是如何将价值纳入其各自的生成模型中的。在此比较的背景下，我们重点介绍了这些框架可以互相告知的几种方式。
Active Inference (AIF) is an emerging framework in the brain sciences which suggests that biological agents act to minimise a variational bound on model evidence. Control-as-Inference (CAI) is a framework within reinforcement learning which casts decision making as a variational inference problem. While these frameworks both consider action selection through the lens of variational inference, their relationship remains unclear. Here, we provide a formal comparison between them and demonstrate that the primary difference arises from how value is incorporated into their respective generative models. In the context of this comparison, we highlight several ways in which these frameworks can inform one another.
