论文标题

Hifacegan:通过协作抑制和补充进行面对翻新

HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment

论文作者

Yang, Lingbo, Liu, Chang, Wang, Pan, Wang, Shanshe, Ren, Peiran, Ma, Siwei, Gao, Wen

论文摘要

现有的面部修复研究通常依赖于培训的降级或明确的指导标签,这通常会导致对具有异质降解和丰富背景内容的现实世界图像的概括能力有限。在本文中,我们通过提出对两种类型的先验的要求(称为“面部翻新”(FR)的要求,我们研究了问题的更具挑战性和实用性的“双盲”版本。具体而言,我们将FR作为语义引导的一代问题提出,并通过协作抑制和补给(CSR)方法解决了这一问题。这导致了Hifacegan,这是一个多阶段框架,其中包含几个嵌套的CSR单元,该单元逐渐根据从前端内容自适应抑制模块中提取的层次结构语义指导逐渐补充面部细节。关于合成和真实面部图像的广泛实验已经验证了Hifacegan在广泛具有挑战性的恢复子任务中的出色性能,证明了其多功能性,鲁棒性和对现实世界面部处理应用程序的能力。

Existing face restoration researches typically relies on either the degradation prior or explicit guidance labels for training, which often results in limited generalization ability over real-world images with heterogeneous degradations and rich background contents. In this paper, we investigate the more challenging and practical "dual-blind" version of the problem by lifting the requirements on both types of prior, termed as "Face Renovation"(FR). Specifically, we formulated FR as a semantic-guided generation problem and tackle it with a collaborative suppression and replenishment (CSR) approach. This leads to HiFaceGAN, a multi-stage framework containing several nested CSR units that progressively replenish facial details based on the hierarchical semantic guidance extracted from the front-end content-adaptive suppression modules. Extensive experiments on both synthetic and real face images have verified the superior performance of HiFaceGAN over a wide range of challenging restoration subtasks, demonstrating its versatility, robustness and generalization ability towards real-world face processing applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源