论文标题

学习全频区域自适应表示真实图像超分辨率

Learning Omni-frequency Region-adaptive Representations for Real Image Super-Resolution

论文作者

Li, Xin, Jin, Xin, Yu, Tao, Pang, Yingxue, Sun, Simeng, Zhang, Zhizheng, Chen, Zhibo

论文摘要

传统的单图像超分辨率(SISR)方法侧重于解决单一和均匀的降解(即,双曲板下采样),由于复杂的现实降解,当应用于现实世界中的低分辨率(LR)图像时,通常会遭受性能差。解决这种更具挑战性的真实形象超分辨率(REALSR)问题的关键在于学习特征表示,既有信息又了解内容。在本文中,我们提出了一个频率区域自适应网络(ORNET)来应对这两个挑战,在这里我们称之为所有低频,中和高频的功能Omni频率特征。具体而言,我们从频率角度开始,并设计一个频率分解(FD)模块,以分离不同的频率组件,以全面补偿实际LR图像损失的信息。然后,考虑到真实LR图像的不同区域丢失了不同的频率信息,我们通过利用动态卷积和空间注意力来为不同区域的自适应恢复频率组件,进一步设计区域适应性频率聚集(RFA)模块。广泛的实验认可了我们的或网络对REALSR的有效和方案 - 不合时宜的性质。

Traditional single image super-resolution (SISR) methods that focus on solving single and uniform degradation (i.e., bicubic down-sampling), typically suffer from poor performance when applied into real-world low-resolution (LR) images due to the complicated realistic degradations. The key to solving this more challenging real image super-resolution (RealSR) problem lies in learning feature representations that are both informative and content-aware. In this paper, we propose an Omni-frequency Region-adaptive Network (ORNet) to address both challenges, here we call features of all low, middle and high frequencies omni-frequency features. Specifically, we start from the frequency perspective and design a Frequency Decomposition (FD) module to separate different frequency components to comprehensively compensate the information lost for real LR image. Then, considering the different regions of real LR image have different frequency information lost, we further design a Region-adaptive Frequency Aggregation (RFA) module by leveraging dynamic convolution and spatial attention to adaptively restore frequency components for different regions. The extensive experiments endorse the effective, and scenario-agnostic nature of our OR-Net for RealSR.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源