论文标题
单次自由式舞蹈重演
Single-Shot Freestyle Dance Reenactment
论文作者
论文摘要
源舞者和目标人之间运动转移的任务是姿势转移问题的特殊情况，在该情况下，目标人会根据舞者的动作改变姿势。 在这项工作中，我们提出了一种新颖的方法，可以通过任意视频序列来激发单个图像，在训练过程中看不见。该方法结合了三个网络：（i）分割映射网络，（ii）现实的框架渲染网络和（iii）面部改进网络。通过将这项任务分为三个阶段，我们能够获得一系列新颖的逼真的框架，从而捕捉自然运动和外观。我们的方法比以前的方法获得了明显更好的视觉质量，并且能够使各种体型和外观动画，这些身体类型和外观在具有挑战性的姿势中被捕获，如实验和补充视频所示。
The task of motion transfer between a source dancer and a target person is a special case of the pose transfer problem, in which the target person changes their pose in accordance with the motions of the dancer. In this work, we propose a novel method that can reanimate a single image by arbitrary video sequences, unseen during training. The method combines three networks: (i) a segmentation-mapping network, (ii) a realistic frame-rendering network, and (iii) a face refinement network. By separating this task into three stages, we are able to attain a novel sequence of realistic frames, capturing natural motion and appearance. Our method obtains significantly better visual quality than previous methods and is able to animate diverse body types and appearances, which are captured in challenging poses, as shown in the experiments and supplementary video.
