论文标题

视觉对话模型可以进行记分吗?探索对话表示如何逐步编码共享知识

Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledge

论文作者

Madureira, Brielen, Schlangen, David

论文摘要

认知上合理的视觉对话模型应在对话环境中保留共同既定事实的心理记分牌。我们提出了一种基于理论的评估方法,用于调查在Visdial数据集中审议的程度模型逐步构建适当进行记分的表示形式。我们的结论是,在分析的模型中适度地存在着在对话中区分共享和私人陈述之间的能力,但并非总是逐步保持一致的,这可能部分是由于在原始任务中对接地相互作用的需求有限。

Cognitively plausible visual dialogue models should keep a mental scoreboard of shared established facts in the dialogue context. We propose a theory-based evaluation method for investigating to what degree models pretrained on the VisDial dataset incrementally build representations that appropriately do scorekeeping. Our conclusion is that the ability to make the distinction between shared and privately known statements along the dialogue is moderately present in the analysed models, but not always incrementally consistent, which may partially be due to the limited need for grounding interactions in the original task.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源