论文标题
在城市道路环境中摄影测量网的结构意识完成
Structure-Aware Completion of Photogrammetric Meshes in Urban Road Environment
论文作者
论文摘要
从空中倾斜图像获得的摄影测量网模型已被广泛用于城市重建。但是,摄影测量网的质地问题也遭受了严重的质地问题,尤其是由于阻塞而导致的道路区域。本文提出了一种结构感知的完成方法,以通过无缝拆除不希望的车辆来提高网格的质量。具体而言,不连续的纹理图集首先通过图形管道渲染到连续的屏幕空间。该渲染还记录了编辑后的必要映射将其定位到原始纹理地图集。车辆区域被标准对象检测方法掩盖,例如更快的rcnn。然后,蒙面区域由基于补丁匹配的路线区域的线性结构和规律进行指导。最后,完整的渲染图像被取代到原始纹理地图集,并且车辆的三角形也被扁平化以改进网格。实验评估和分析是针对三个数据集进行的,这些数据集用不同的传感器和地面样品距离捕获。结果表明,提出的方法可以在卸下车辆后非常现实。道路区域的结构感知完成方法优于流行图像完成方法和消融研究进一步证实了线性指导的有效性。应该注意的是,所提出的方法还能够处理用于大规模场景的瓷砖网格型号。数据集和代码可在vrlab.org.cn/~hanhu/projects/mesh上找到。
Photogrammetric mesh models obtained from aerial oblique images have been widely used for urban reconstruction. However, the photogrammetric meshes also suffer from severe texture problems, especially on the road areas due to occlusion. This paper proposes a structure-aware completion approach to improve the quality of meshes by removing undesired vehicles on the road seamlessly. Specifically, the discontinuous texture atlas is first integrated to a continuous screen space through rendering by the graphics pipeline; the rendering also records necessary mapping for deintegration to the original texture atlas after editing. Vehicle regions are masked by a standard object detection approach, e.g. Faster RCNN. Then, the masked regions are completed guided by the linear structures and regularities in the road region, which is implemented based on Patch Match. Finally, the completed rendered image is deintegrated to the original texture atlas and the triangles for the vehicles are also flattened for improved meshes. Experimental evaluations and analyses are conducted against three datasets, which are captured with different sensors and ground sample distances. The results reveal that the proposed method can quite realistic meshes after removing the vehicles. The structure-aware completion approach for road regions outperforms popular image completion methods and ablation study further confirms the effectiveness of the linear guidance. It should be noted that the proposed method is also capable to handle tiled mesh models for large-scale scenes. Dataset and code are available at vrlab.org.cn/~hanhu/projects/mesh.