论文标题
AIM 2020挑战视频极限超分辨率:方法和结果
AIM 2020 Challenge on Video Extreme Super-Resolution: Methods and Results
论文作者
论文摘要
本文回顾了与AIM 2020在ECCV 2020的AIM 2020研讨会相关的视频极端超分辨率挑战。学到的视频超级分辨率(VSR)的常见缩放因素(VSR)并不超过因素4。在该区域中可以很好地恢复丢失的信息,尤其是在HR视频中,高频内容最多构成文本详细信息的高频内容。这项挑战的任务是高档视频的极端因素为16,这会导致更严重的降级,这也影响了视频的结构完整性。低分辨率(LR)域中的单像素对应于高分辨率(HR)域中的256个像素。由于这种大规模的信息丢失,很难准确恢复丢失的信息。轨道1的设置是为了评估这项苛刻的任务的最先进,在这种任务中,对地面真相的保真度是由PSNR和SSIM衡量的。通过产生合理的高频含量,可以在富裕方面取得更高的质量。因此,轨道2旨在产生视觉令人愉悦的结果,这些结果根据人类的看法进行了排名,并通过用户研究评估。与单像超分辨率(SISR)相反,VSR可以从时间域中的其他信息中受益。但是,这也施加了附加的要求,因为生成的帧需要随着时间的推移而保持一致。
This paper reviews the video extreme super-resolution challenge associated with the AIM 2020 workshop at ECCV 2020. Common scaling factors for learned video super-resolution (VSR) do not go beyond factor 4. Missing information can be restored well in this region, especially in HR videos, where the high-frequency content mostly consists of texture details. The task in this challenge is to upscale videos with an extreme factor of 16, which results in more serious degradations that also affect the structural integrity of the videos. A single pixel in the low-resolution (LR) domain corresponds to 256 pixels in the high-resolution (HR) domain. Due to this massive information loss, it is hard to accurately restore the missing information. Track 1 is set up to gauge the state-of-the-art for such a demanding task, where fidelity to the ground truth is measured by PSNR and SSIM. Perceptually higher quality can be achieved in trade-off for fidelity by generating plausible high-frequency content. Track 2 therefore aims at generating visually pleasing results, which are ranked according to human perception, evaluated by a user study. In contrast to single image super-resolution (SISR), VSR can benefit from additional information in the temporal domain. However, this also imposes an additional requirement, as the generated frames need to be consistent along time.