论文标题

通过异质图网络将常识性知识纳入故事结束世代

Incorporating Commonsense Knowledge into Story Ending Generation via Heterogeneous Graph Networks

论文作者

Wang, Jiaan, Zou, Beiqi, Li, Zhixu, Qu, Jianfeng, Zhao, Pengpeng, Liu, An, Zhao, Lei

论文摘要

故事结局是一项有趣且具有挑战性的任务,旨在在故事背景下产生连贯且合理的结局。任务的关键挑战在于如何充分理解故事的环境并有效地处理故事线索背后的隐含知识,而这些线索背后的知识仍未被以前的工作所探索。在本文中,我们提出了一个故事异质图网络(SHGN),以明确对不同粒度层面的故事上下文的信息进行建模,并在其中之间建立了多元化的互动关系。详细说明,我们将常识性知识,单词和句子视为三种类型的节点。为了汇总非本地信息,还引入了全局节点。鉴于这个异质图网络,节点表示形式是通过图形传播更新的,该图表可以充分利用常识知识来促进故事理解。此外,我们设计了两个辅助任务,以隐式捕获情感趋势,关键事件在上下文中。在多任务学习策略中,辅助任务与主要故事结束生成任务共同优化。关于Rocstories语料库的广泛实验表明,开发的模型可实现新的最新性能。人类研究进一步表明,我们的模型产生了更合理的故事结局。

Story ending generation is an interesting and challenging task, which aims to generate a coherent and reasonable ending given a story context. The key challenges of the task lie in how to comprehend the story context sufficiently and handle the implicit knowledge behind story clues effectively, which are still under-explored by previous work. In this paper, we propose a Story Heterogeneous Graph Network (SHGN) to explicitly model both the information of story context at different granularity levels and the multi-grained interactive relations among them. In detail, we consider commonsense knowledge, words and sentences as three types of nodes. To aggregate non-local information, a global node is also introduced. Given this heterogeneous graph network, the node representations are updated through graph propagation, which adequately utilizes commonsense knowledge to facilitate story comprehension. Moreover, we design two auxiliary tasks to implicitly capture the sentiment trend and key events lie in the context. The auxiliary tasks are jointly optimized with the primary story ending generation task in a multi-task learning strategy. Extensive experiments on the ROCStories Corpus show that the developed model achieves new state-of-the-art performances. Human study further demonstrates that our model generates more reasonable story endings.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源