论文标题

跨域对象检测通过粗到精细的特征适应

Cross-domain Object Detection through Coarse-to-Fine Feature Adaptation

论文作者

Zheng, Yangtao, Huang, Di, Liu, Songtao, Wang, Yunhong

论文摘要

近年来,基于深度学习的对象检测取得了巨大进展。但是,由于域转移问题,将现成的检测器应用于看不见的域,导致性能下降。为了解决这一问题,本文提出了一种新颖的粗到细节适应方法来跨域对象检测。在粗粒阶段,与文献中使用的粗糙图像级或实例级特征比对不同,前景区域是通过采用注意机制来提取的,并根据公共特征空间中的多层对抗性学习来根据其边际分布对齐。在细粒阶段,我们通过最大程度地减少具有相同类别但与不同域的全局原型的距离来进行前景的有条件分布对齐。得益于这种粗到最新的特征适应,可以有效地转移前景区域的域知识。在各种跨域检测方案中进行了广泛的实验。结果是最先进的,它证明了拟议方法的广泛适用性和有效性。

Recent years have witnessed great progress in deep learning based object detection. However, due to the domain shift problem, applying off-the-shelf detectors to an unseen domain leads to significant performance drop. To address such an issue, this paper proposes a novel coarse-to-fine feature adaptation approach to cross-domain object detection. At the coarse-grained stage, different from the rough image-level or instance-level feature alignment used in the literature, foreground regions are extracted by adopting the attention mechanism, and aligned according to their marginal distributions via multi-layer adversarial learning in the common feature space. At the fine-grained stage, we conduct conditional distribution alignment of foregrounds by minimizing the distance of global prototypes with the same category but from different domains. Thanks to this coarse-to-fine feature adaptation, domain knowledge in foreground regions can be effectively transferred. Extensive experiments are carried out in various cross-domain detection scenarios. The results are state-of-the-art, which demonstrate the broad applicability and effectiveness of the proposed approach.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源