论文标题
多源无监督的域通过伪目标域适应
Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domain
论文作者
论文摘要
多源域适应性(MDA)旨在将知识从多个源域转移到未标记的目标域。 MDA是由于严重的领域转移而成为一项具有挑战性的任务,这不仅存在于目标和来源之间,而且存在于各种来源之间。 MDA的先前研究估计了源域的混合分布,或者结合了多个单一源模型,但其中很少有人深入研究各种源域之间的相关信息。因此,我们提出了一种新型的MDA方法,称为MDA(PTMDA)的伪靶。具体而言,PTMDA使用具有度量约束的对抗性学习将每个源和目标域映射到一个特定于组的子空间中,并相应地构造了一系列的伪目标域。然后,我们将其余的源域与子空间中的伪目标域保持一致,这允许通过对伪目标域的培训来利用其他结构化源信息,并提高实际目标域的性能。此外,为了提高深神经网络(DNN)的可传递性,我们用有效的匹配归一化层代替了传统的批归归式层,该层可以在DNN的潜在层中实施比对,从而获得了进一步的促进。我们给出理论分析表明,PTMDA整个可以减少目标误差的绑定,并导致MDA设置中目标风险的更好近似。广泛的实验证明了PTMDA对MDA任务的有效性,因为它在大多数实验环境中都优于最先进的方法。
Multi-source domain adaptation (MDA) aims to transfer knowledge from multiple source domains to an unlabeled target domain. MDA is a challenging task due to the severe domain shift, which not only exists between target and source but also exists among diverse sources. Prior studies on MDA either estimate a mixed distribution of source domains or combine multiple single-source models, but few of them delve into the relevant information among diverse source domains. For this reason, we propose a novel MDA approach, termed Pseudo Target for MDA (PTMDA). Specifically, PTMDA maps each group of source and target domains into a group-specific subspace using adversarial learning with a metric constraint, and constructs a series of pseudo target domains correspondingly. Then we align the remainder source domains with the pseudo target domain in the subspace efficiently, which allows to exploit additional structured source information through the training on pseudo target domain and improves the performance on the real target domain. Besides, to improve the transferability of deep neural networks (DNNs), we replace the traditional batch normalization layer with an effective matching normalization layer, which enforces alignments in latent layers of DNNs and thus gains further promotion. We give theoretical analysis showing that PTMDA as a whole can reduce the target error bound and leads to a better approximation of the target risk in MDA settings. Extensive experiments demonstrate PTMDA's effectiveness on MDA tasks, as it outperforms state-of-the-art methods in most experimental settings.