论文标题
HFT:通过混合特征转换来提起透视表示
HFT: Lifting Perspective Representations via Hybrid Feature Transformation
论文作者
论文摘要
自主驾驶需要准确,详细的鸟类视图(BEV)语义细分以进行决策,这是高级场景感知的最具挑战性的任务之一。从额叶视图到BEV的特征转换是BEV语义分割的关键技术。现有作品可以大致分为两类,即基于相机模型的功能转换(CBFT)和无摄像机模型功能转换(CFFT)。在本文中,我们通过经验分析了CBFT和CFFT之间的重要差异。前者基于平坦的假设的变换特征,这可能会导致位于接地平面上方的区域的扭曲。由于缺乏几何先验和耗时的计算,后者的分割性能受到限制。为了获得收益并避免CBFT和CFFT的缺点,我们提出了一个具有混合特征转换模块(HFT)的新框架。具体而言,我们将HFT生成的特征图解除了估计BEV中室外场景的布局。此外,我们设计了一种相互学习方案,以应用模仿特征来增强混合变换。值得注意的是,广泛的实验表明,与表现最好的现有方法相比,HFT可忽略不计,HFT在Argoverse数据集的相对提高13.3%,而Kitti 3D对象数据集的相对提高为13.8%。这些代码可在https://github.com/jiayuzou2020/hft上找到。
Autonomous driving requires accurate and detailed Bird's Eye View (BEV) semantic segmentation for decision making, which is one of the most challenging tasks for high-level scene perception. Feature transformation from frontal view to BEV is the pivotal technology for BEV semantic segmentation. Existing works can be roughly classified into two categories, i.e., Camera model-Based Feature Transformation (CBFT) and Camera model-Free Feature Transformation (CFFT). In this paper, we empirically analyze the vital differences between CBFT and CFFT. The former transforms features based on the flat-world assumption, which may cause distortion of regions lying above the ground plane. The latter is limited in the segmentation performance due to the absence of geometric priors and time-consuming computation. In order to reap the benefits and avoid the drawbacks of CBFT and CFFT, we propose a novel framework with a Hybrid Feature Transformation module (HFT). Specifically, we decouple the feature maps produced by HFT for estimating the layout of outdoor scenes in BEV. Furthermore, we design a mutual learning scheme to augment hybrid transformation by applying feature mimicking. Notably, extensive experiments demonstrate that with negligible extra overhead, HFT achieves a relative improvement of 13.3% on the Argoverse dataset and 16.8% on the KITTI 3D Object datasets compared to the best-performing existing method. The codes are available at https://github.com/JiayuZou2020/HFT.