论文标题

通过政策蒸馏强化学习开发具有长期奖励的多任务建议

Developing Multi-Task Recommendations with Long-Term Rewards via Policy Distilled Reinforcement Learning

论文作者

Liu, Xi, Li, Li, Hsieh, Ping-Chun, Xie, Muhe, Ge, Yong, Chen, Rui

论文摘要

随着在线产品和内容的爆炸性增长,推荐技术被认为是克服信息超负荷,改善用户体验并增加业务收入的有效工具。近年来,我们观察到了一种新的逃亡者,即同时考虑多个相关建议任务的长期奖励。长期奖励的考虑与业务收入和增长密切相关。由于知识共享在多任务学习中的知识共享,同时学习多个任务通常可以提高单个任务的性能。尽管一些现有的作品已经在建议中研究了长期奖励,但它们主要集中于单个建议任务。在本文中,我们提出{\ it podire}:A \下划线{po} Licy \下划线{di} stalled \ listlline \ undersline {re} contrander {re} cormender可以解决建议的长期奖励,并同时处理多个建议任务。这种新颖的建议解决方案是基于深入强化学习和知识蒸馏技术的婚姻,该技术能够在不同任务之间建立知识共享并减少学习模型的规模。预计最终的模型将获得更好的性能,并为实时推荐服务提供较低的响应延迟。我们与世界上最大的商业手机游戏平台之一的三星游戏发射器合作,我们对大规模真实数据进行了全面的实验研究,其中包含数亿个事件,并表明我们的解决方案在几个标准评估指标方面都优于许多先进的方法。

With the explosive growth of online products and content, recommendation techniques have been considered as an effective tool to overcome information overload, improve user experience, and boost business revenue. In recent years, we have observed a new desideratum of considering long-term rewards of multiple related recommendation tasks simultaneously. The consideration of long-term rewards is strongly tied to business revenue and growth. Learning multiple tasks simultaneously could generally improve the performance of individual task due to knowledge sharing in multi-task learning. While a few existing works have studied long-term rewards in recommendations, they mainly focus on a single recommendation task. In this paper, we propose {\it PoDiRe}: a \underline{po}licy \underline{di}stilled \underline{re}commender that can address long-term rewards of recommendations and simultaneously handle multiple recommendation tasks. This novel recommendation solution is based on a marriage of deep reinforcement learning and knowledge distillation techniques, which is able to establish knowledge sharing among different tasks and reduce the size of a learning model. The resulting model is expected to attain better performance and lower response latency for real-time recommendation services. In collaboration with Samsung Game Launcher, one of the world's largest commercial mobile game platforms, we conduct a comprehensive experimental study on large-scale real data with hundreds of millions of events and show that our solution outperforms many state-of-the-art methods in terms of several standard evaluation metrics.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源