论文标题

学会从空气外图像中提取建筑足迹

Learning to Extract Building Footprints from Off-Nadir Aerial Images

论文作者

Wang, Jinwang, Meng, Lingxuan, Li, Weijia, Yang, Wen, Yu, Lei, Xia, Gui-Song

论文摘要

从空中图像中提取建筑足迹对于使用摄影测量计算机视觉技术的精确城市映射至关重要。现有的方法主要假定建筑物的屋顶和占地面积已充分重叠,这可能无法在距离航空图像中保持,因为它们之间通常有很大的偏移。在本文中,我们提出了一个偏移矢量学习方案,该方案将建筑物占地图像中的建筑物足迹提取问题变成了建筑屋顶的实例级关节预测问题及其相应的“屋顶到足迹”偏移矢量。因此,可以通过根据预测的偏移矢量翻译预测的屋顶面罩来估算足迹。我们进一步提出了一个简单但有效的功能级偏移扩展模块,该模块可以通过引入几乎没有额外的成本来显着完善偏移矢量预测。此外,在本文中创建并发布了一个新的数据集(BONAI)的建筑物(BONAI)。它包含3,300台空中图像的268,958个建筑实例,并带有完全注释的实例级别的屋顶,占地面积和相应的偏移矢量。 BONAI数据集的实验表明,我们的方法在F1得分中实现了最先进的方法,优于其他竞争对手3.37至7.39分。代码,数据集和训练有素的模型可在https://github.com/jwwangchn/bonai.git上找到。

Extracting building footprints from aerial images is essential for precise urban mapping with photogrammetric computer vision technologies. Existing approaches mainly assume that the roof and footprint of a building are well overlapped, which may not hold in off-nadir aerial images as there is often a big offset between them. In this paper, we propose an offset vector learning scheme, which turns the building footprint extraction problem in off-nadir images into an instance-level joint prediction problem of the building roof and its corresponding "roof to footprint" offset vector. Thus the footprint can be estimated by translating the predicted roof mask according to the predicted offset vector. We further propose a simple but effective feature-level offset augmentation module, which can significantly refine the offset vector prediction by introducing little extra cost. Moreover, a new dataset, Buildings in Off-Nadir Aerial Images (BONAI), is created and released in this paper. It contains 268,958 building instances across 3,300 aerial images with fully annotated instance-level roof, footprint, and corresponding offset vector for each building. Experiments on the BONAI dataset demonstrate that our method achieves the state-of-the-art, outperforming other competitors by 3.37 to 7.39 points in F1-score. The codes, datasets, and trained models are available at https://github.com/jwwangchn/BONAI.git.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源