论文标题
展开的盲图超级分辨率的深内核估计
Unfolded Deep Kernel Estimation for Blind Image Super-resolution
论文作者
论文摘要
盲图超级分辨率(BISR)旨在从其低分辨率对应物中重建高分辨率图像,并因未知的模糊内核和噪声而降级。已经提出了许多基于神经网络的深度网络方法来解决这个具有挑战性的问题,而无需考虑图像降解模型。但是,他们在很大程度上依靠训练集,并且在推理过程中通常无法使用看不见的模糊内核来处理图像。还提出了深层展开的方法通过使用降解模型来执行BISR。但是,现有的深层展开方法无法明确求解展开目标函数的数据项,从而限制了它们在模糊内核估计中的能力。在这项工作中,我们提出了一种新颖的深内核估计(UDKE)方法,据我们最大的知识,该方法首次以高效率明确解决了数据术语。基于UDKE的BISR方法可以以端到端的方式共同学习图像和内核先验,并且可以有效利用训练数据和图像退化模型中的信息。基准数据集和现实世界数据上的实验表明,所提出的UDKE方法可以很好地预测推理中没有看到的非高斯模糊内核,从而比先进的表现更好地表现出了比卡特的表现。 UDKE的源代码可在以下网址获得:https://github.com/natezhenghy/udke。
Blind image super-resolution (BISR) aims to reconstruct a high-resolution image from its low-resolution counterpart degraded by unknown blur kernel and noise. Many deep neural network based methods have been proposed to tackle this challenging problem without considering the image degradation model. However, they largely rely on the training sets and often fail to handle images with unseen blur kernels during inference. Deep unfolding methods have also been proposed to perform BISR by utilizing the degradation model. Nonetheless, the existing deep unfolding methods cannot explicitly solve the data term of the unfolding objective function, limiting their capability in blur kernel estimation. In this work, we propose a novel unfolded deep kernel estimation (UDKE) method, which, for the first time to our best knowledge, explicitly solves the data term with high efficiency. The UDKE based BISR method can jointly learn image and kernel priors in an end-to-end manner, and it can effectively exploit the information in both training data and image degradation model. Experiments on benchmark datasets and real-world data demonstrate that the proposed UDKE method could well predict complex unseen non-Gaussian blur kernels in inference, achieving significantly better BISR performance than state-of-the-art. The source code of UDKE is available at: https://github.com/natezhenghy/UDKE.