论文标题
重新考虑无监督的域适应性语义分割
Rethinking Unsupervised Domain Adaptation for Semantic Segmentation
论文作者
论文摘要
无监督的域适应性(UDA)将在一个域(称为源)上训练的模型适应一个仅使用未标记数据的新型域(称为目标)。由于其较高的注释成本,研究人员开发了许多UDA方法来进行语义分割,这些方法假设目标域中没有标记的样本可用。我们质疑该假设的实用性,原因有两个。首先,在使用UDA方法训练模型后,我们必须以某种方式在部署前验证该模型。其次,UDA方法至少具有一些需要确定的超参数。最可靠的解决方案是使用验证数据,即一定量的标记目标域样本来评估模型。关于UDA基本假设的这个问题使我们从以数据为中心的角度重新考虑UDA。具体而言,我们假设我们可以访问最低标记的数据水平。然后,我们问找到现有UDA方法的良好超参数需要多少。然后,我们考虑如果我们使用相同的数据进行同一模型的监督培训,例如填充训练。我们进行了实验,以流行的情况为{gta5,synthia} $ \ rightarrow $ cityScapes。我们发现,我)选择良好的超参数仅需要一些标记的图像来进行某些UDA方法,而对于其他方法来说,更多的图像; ii)简单的填充效果非常好;如果只有数十个标记的图像可用,则它的表现要优于许多UDA方法。
Unsupervised domain adaptation (UDA) adapts a model trained on one domain (called source) to a novel domain (called target) using only unlabeled data. Due to its high annotation cost, researchers have developed many UDA methods for semantic segmentation, which assume no labeled sample is available in the target domain. We question the practicality of this assumption for two reasons. First, after training a model with a UDA method, we must somehow verify the model before deployment. Second, UDA methods have at least a few hyper-parameters that need to be determined. The surest solution to these is to evaluate the model using validation data, i.e., a certain amount of labeled target-domain samples. This question about the basic assumption of UDA leads us to rethink UDA from a data-centric point of view. Specifically, we assume we have access to a minimum level of labeled data. Then, we ask how much is necessary to find good hyper-parameters of existing UDA methods. We then consider what if we use the same data for supervised training of the same model, e.g., finetuning. We conducted experiments to answer these questions with popular scenarios, {GTA5, SYNTHIA}$\rightarrow$Cityscapes. We found that i) choosing good hyper-parameters needs only a few labeled images for some UDA methods whereas a lot more for others; and ii) simple finetuning works surprisingly well; it outperforms many UDA methods if only several dozens of labeled images are available.