论文标题

重新访问无监督域适应的深度子空间对齐

Revisiting Deep Subspace Alignment for Unsupervised Domain Adaptation

论文作者

Thopalli, Kowshik, Thiagarajan, Jayaraman J, Anirudh, Rushil, Turaga, Pavan K

论文摘要

无监督的域适应性(UDA)旨在将知识从标记的源域转移和将知识调整到未标记的目标域。传统上,基于子空间的方法构成了解决此问题的重要解决方案。尽管它们具有数学优雅和障碍性,但通常发现这些方法在使用复杂的,现实世界中的数据集生产域不变特征方面无效。本文的激励是通过深层网络的代表学习进步,重新审视了UDA子空间对齐的使用,并提出了一种新型的适应算法,该算法始终导致改善概括。与现有的基于对抗训练的DA方法相反,我们的方法隔离株具有学习和分配对准步骤,并利用主要的辅助优化策略来有效平衡域不变性和模型保真度的目标。在提供目标数据和计算需求的显着降低的同时,我们的基于子空间的DA在几种标准的UDA基准上表现出色,有时甚至优于最先进的方法。此外,子空间对准会导致内在良好的模型,即使在具有挑战性的部分DA设置中也表现出强烈的概括。最后,我们的UDA框架的设计固有地支持在测试时逐步适应对新目标域的渐进式适应,而无需从头开始重新训练模型。总而言之,由强大的功能学习者和有效的优化策略提供支持,我们建立了基于子空间的DA,作为视觉识别的高效方法。

Unsupervised domain adaptation (UDA) aims to transfer and adapt knowledge from a labeled source domain to an unlabeled target domain. Traditionally, subspace-based methods form an important class of solutions to this problem. Despite their mathematical elegance and tractability, these methods are often found to be ineffective at producing domain-invariant features with complex, real-world datasets. Motivated by the recent advances in representation learning with deep networks, this paper revisits the use of subspace alignment for UDA and proposes a novel adaptation algorithm that consistently leads to improved generalization. In contrast to existing adversarial training-based DA methods, our approach isolates feature learning and distribution alignment steps, and utilizes a primary-auxiliary optimization strategy to effectively balance the objectives of domain invariance and model fidelity. While providing a significant reduction in target data and computational requirements, our subspace-based DA performs competitively and sometimes even outperforms state-of-the-art approaches on several standard UDA benchmarks. Furthermore, subspace alignment leads to intrinsically well-regularized models that demonstrate strong generalization even in the challenging partial DA setting. Finally, the design of our UDA framework inherently supports progressive adaptation to new target domains at test-time, without requiring retraining of the model from scratch. In summary, powered by powerful feature learners and an effective optimization strategy, we establish subspace-based DA as a highly effective approach for visual recognition.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源