论文标题

PMP-NET ++:通过变压器增强多步点移动路径的点云完成

PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-step Point Moving Paths

论文作者

Wen, Xin, Xiang, Peng, Han, Zhizhong, Cao, Yan-Pei, Wan, Pengfei, Zheng, Wen, Liu, Yu-Shen

论文摘要

点云完成疑虑,以预测不完整的3D形状丢失零件。一种常见的策略是根据不完整的输入产生完整的形状。但是,点云的无序性质将降低高质量3D形状的生成,因为在生成过程中,很难使用提取的潜在代码在生成过程中捕获无序的详细拓扑和结构。我们通过将完成作为点云变形过程来解决此问题。具体而言,我们设计了一个名为PMP-NET ++的新型神经网络,以模仿地球搬运工的行为。它移动每个不完整输入点以获得一个完整的点云,其中点移动路径(PMP)的总距离应最短。因此,PMP-NET ++根据点移动距离的约束预测每个点的唯一PMP。该网络在点级上学习了严格而独特的对应关系,从而提高了预测的完整形状的质量。此外,由于移动点在很大程度上取决于网络学到的每点功能,因此我们进一步引入了变压器增强的表示网络,从而大大提高了PMP-NET ++的完成性能。我们在形状完成中进行了全面的实验,并进一步探索了Point Cloud上采样的应用,这表明PMP-NET ++在最新的点云完成/上取消采样方法上表现出了不平凡的改进。

Point cloud completion concerns to predict missing part for incomplete 3D shapes. A common strategy is to generate complete shape according to incomplete input. However, unordered nature of point clouds will degrade generation of high-quality 3D shapes, as detailed topology and structure of unordered points are hard to be captured during the generative process using an extracted latent code. We address this problem by formulating completion as point cloud deformation process. Specifically, we design a novel neural network, named PMP-Net++, to mimic behavior of an earth mover. It moves each point of incomplete input to obtain a complete point cloud, where total distance of point moving paths (PMPs) should be the shortest. Therefore, PMP-Net++ predicts unique PMP for each point according to constraint of point moving distances. The network learns a strict and unique correspondence on point-level, and thus improves quality of predicted complete shape. Moreover, since moving points heavily relies on per-point features learned by network, we further introduce a transformer-enhanced representation learning network, which significantly improves completion performance of PMP-Net++. We conduct comprehensive experiments in shape completion, and further explore application on point cloud up-sampling, which demonstrate non-trivial improvement of PMP-Net++ over state-of-the-art point cloud completion/up-sampling methods.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源