论文标题

通过深层隐式表面网络学习类别级别的形状显着性

Learning Category-level Shape Saliency via Deep Implicit Surface Networks

论文作者

Wu, Chaozheng, Sun, Lin, Xu, Xun, Jia, Kui

论文摘要

本文是由于对定义对象形状类别的基本好奇心的动机。例如,我们可能有一个常见的知识是飞机有翅膀,椅子有腿。鉴于同一类别的不同实例之间存在较大的形状变化,我们对开发为连续对象表面上的单个点定义的数量正式感兴趣。该数量指定单个表面点如何有助于形状形成为类别。我们称其为类别级别显着性或简称形状显着性的数量。从技术上讲,我们建议从深层隐式表面网络中学习与同一类别的形状实例的显着图。通过约束输入潜在代码的能力,可以预测隐式表面场中采样点的明智显着分数。我们还通过额外的对比度训练增强了显着性预测。我们期望这种学识渊博的形状显着性表面图具有平滑度,对称性和语义代表性的特性。我们通过将我们的方法与显着性计算的替代方法进行比较来验证这些属性。值得注意的是,我们表明,通过利用学到的形状显着性,我们能够重建对象表面的类别呈升压或特定于实例的部分。学习显着性的语义代表性也反映在其功效中,以指导表面点的选择以获得更好的点云分类。

This paper is motivated from a fundamental curiosity on what defines a category of object shapes. For example, we may have the common knowledge that a plane has wings, and a chair has legs. Given the large shape variations among different instances of a same category, we are formally interested in developing a quantity defined for individual points on a continuous object surface; the quantity specifies how individual surface points contribute to the formation of the shape as the category. We term such a quantity as category-level shape saliency or shape saliency for short. Technically, we propose to learn saliency maps for shape instances of a same category from a deep implicit surface network; sensible saliency scores for sampled points in the implicit surface field are predicted by constraining the capacity of input latent code. We also enhance the saliency prediction with an additional loss of contrastive training. We expect such learned surface maps of shape saliency to have the properties of smoothness, symmetry, and semantic representativeness. We verify these properties by comparing our method with alternative ways of saliency computation. Notably, we show that by leveraging the learned shape saliency, we are able to reconstruct either category-salient or instance-specific parts of object surfaces; semantic representativeness of the learned saliency is also reflected in its efficacy to guide the selection of surface points for better point cloud classification.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源