论文标题
跨分辨率人员重新识别的学习解决方案自适应表示
Learning Resolution-Adaptive Representations for Cross-Resolution Person Re-Identification
论文作者
论文摘要
跨分辨率的人重新识别(CRREID)问题旨在将低分辨率(LR)查询身份图像与高分辨率(HR)画廊图像匹配。这是一个具有挑战性且实用的问题,因为由于现实世界相机的捕获条件不同,查询图像通常会遭受分辨率退化。为了解决此问题,最新的(SOTA)解决方案要么学习分辨率不变的表示,要么采用超分辨率(SR)模块以从LR查询中恢复丢失的信息。本文探讨了一种无SR的范式,可以通过动态度量直接比较HR和LR图像,该指标适应了查询图像的分辨率。我们通过学习解决方案自适应表示来实现这一想法,以进行跨分辨率比较。具体而言,我们提出了两种分辨率自适应机制。第一个将特定于分辨率的信息分解为深神经网络倒数第二层中不同的子向量,从而创建了不同的长度表示。为了更好地提取与分辨率相关的信息,我们进一步建议学习中间残留特征块的分辨率自适应掩模。提出了一种新颖的渐进学习策略来正确训练这些面具。这两种机制结合在一起以提高CRREID的性能。实验结果表明,所提出的方法优于现有方法,并在多个CRREID基准上实现SOTA性能。
The cross-resolution person re-identification (CRReID) problem aims to match low-resolution (LR) query identity images against high resolution (HR) gallery images. It is a challenging and practical problem since the query images often suffer from resolution degradation due to the different capturing conditions from real-world cameras. To address this problem, state-of-the-art (SOTA) solutions either learn the resolution-invariant representation or adopt super-resolution (SR) module to recover the missing information from the LR query. This paper explores an alternative SR-free paradigm to directly compare HR and LR images via a dynamic metric, which is adaptive to the resolution of a query image. We realize this idea by learning resolution-adaptive representations for cross-resolution comparison. Specifically, we propose two resolution-adaptive mechanisms. The first one disentangles the resolution-specific information into different sub-vectors in the penultimate layer of the deep neural networks, and thus creates a varying-length representation. To better extract resolution-dependent information, we further propose to learn resolution-adaptive masks for intermediate residual feature blocks. A novel progressive learning strategy is proposed to train those masks properly. These two mechanisms are combined to boost the performance of CRReID. Experimental results show that the proposed method is superior to existing approaches and achieves SOTA performance on multiple CRReID benchmarks.