论文标题
通过内容传输的语义分割的无监督域的适应
Unsupervised Domain Adaptation for Semantic Segmentation by Content Transfer
论文作者
论文摘要
在本文中,我们针对语义分割的无监督域的适应性(UDA),旨在使用标记的合成数据分割未标记的实际数据。用于语义分割的UDA的主要问题依赖于减少真实图像和合成图像之间的域间隙。为了解决这个问题,我们专注于将图像中的信息分开为内容和样式。在这里,只有内容具有语义分割的提示,并且样式使域间隙造成了差距。因此,即使使用合成数据学习,图像中内容和样式的精确分离也会导致对实际数据的监督。为了充分利用这种效果,我们提出了零风格的损失。即使我们完美地提取了真正的域中语义细分的内容,但另一个主要挑战,类别不平衡问题,仍然存在于UDA中,以进行语义细分。我们通过将尾部类的内容从合成域转移到真实域来解决这个问题。实验结果表明,所提出的方法在主要两个UDA设置上实现了语义分割的最新性能。
In this paper, we tackle the unsupervised domain adaptation (UDA) for semantic segmentation, which aims to segment the unlabeled real data using labeled synthetic data. The main problem of UDA for semantic segmentation relies on reducing the domain gap between the real image and synthetic image. To solve this problem, we focused on separating information in an image into content and style. Here, only the content has cues for semantic segmentation, and the style makes the domain gap. Thus, precise separation of content and style in an image leads to effect as supervision of real data even when learning with synthetic data. To make the best of this effect, we propose a zero-style loss. Even though we perfectly extract content for semantic segmentation in the real domain, another main challenge, the class imbalance problem, still exists in UDA for semantic segmentation. We address this problem by transferring the contents of tail classes from synthetic to real domain. Experimental results show that the proposed method achieves the state-of-the-art performance in semantic segmentation on the major two UDA settings.