论文标题

绘图图:使用强化学习创建表现力的故事情节可视化

PlotThread: Creating Expressive Storyline Visualizations using Reinforcement Learning

论文作者

Tang, Tan, Li, Renzhong, Wu, Xinke, Liu, Shuhan, Knittel, Johannes, Koch, Steffen, Ertl, Thomas, Yu, Lingyun, Ren, Peiran, Wu, Yingcai

论文摘要

故事情节可视化是呈现情节演变并揭示角色之间风景秀丽的一种有效手段。但是,故事情节可视化的设计是一项艰巨的任务,因为用户需要在美学目标和叙事约束之间取得平衡。尽管基于优化的方法在产生美学和清晰的布局方面得到了显着改善,但现有的(半)自动方法仍然受到限制,但在1)有效探索故事情节设计空间和2)故事情节布局的灵活自定义。在这项工作中,我们提出了一个加强学习框架,以培训AI代理,该框架可以帮助用户有效地探索设计空间并生成良好的故事情节。基于框架,我们介绍了PlotThread,这是一种创作工具,该工具集成了一组灵活的交互,以支持故事情节可视化的轻松自定义。为了将AI代理商无缝整合到创作过程中,我们采用了一种混合宣传的方法,代理商和设计师都在相同的画布上工作,以增强故事情节的协作设计。我们通过定性和定量实验评估增强学习模型,并使用用例集合来证明PlotThread的用法。

Storyline visualizations are an effective means to present the evolution of plots and reveal the scenic interactions among characters. However, the design of storyline visualizations is a difficult task as users need to balance between aesthetic goals and narrative constraints. Despite that the optimization-based methods have been improved significantly in terms of producing aesthetic and legible layouts, the existing (semi-) automatic methods are still limited regarding 1) efficient exploration of the storyline design space and 2) flexible customization of storyline layouts. In this work, we propose a reinforcement learning framework to train an AI agent that assists users in exploring the design space efficiently and generating well-optimized storylines. Based on the framework, we introduce PlotThread, an authoring tool that integrates a set of flexible interactions to support easy customization of storyline visualizations. To seamlessly integrate the AI agent into the authoring process, we employ a mixed-initiative approach where both the agent and designers work on the same canvas to boost the collaborative design of storylines. We evaluate the reinforcement learning model through qualitative and quantitative experiments and demonstrate the usage of PlotThread using a collection of use cases.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源