论文标题

我们学习更好的道路坑洼检测:从注意聚集到对抗领域的适应

We Learn Better Road Pothole Detection: from Attention Aggregation to Adversarial Domain Adaptation

论文作者

Fan, Rui, Wang, Hengli, Bocus, Mohammud J., Liu, Ming

论文摘要

经过认证检查员进行的手动视觉检查仍然是公路坑洞检测的主要形式。但是,这个过程不仅乏味,耗时且昂贵,而且对检查员来说也很危险。此外,道路坑洞的检测结果始终是主观的,因为它们完全取决于个人体验。我们最近引入的差异(或反向深度)转换算法可以更好地区分损坏和未损坏的道路区域,并且可以轻松地部署到任何语义细分网络中,以获得更好的道路坑洼检测结果。为了提高性能,我们提出了一个新颖的注意聚集(AA)框架,该框架具有不同类型的注意模块的优势。此外,我们基于对抗性域的适应性开发了一种有效的训练集增强技术,其中生成了合成道路RGB图像和转化的道路差异(或反向深度)图像,以增强语义分割网络的训练。实验结果表明,首先,转化的差异(或反向深度)图像变得更加信息。其次,我们表现最好的实现AA-UNET和AA-RTFNET,分别优于所有其他最先进的单模式和数据融合网络,用于公路孔洞检测;最后,基于对抗性领域适应的训练集增强技术不仅提高了最先进的语义分割网络的准确性,而且还提高了它们的收敛性。

Manual visual inspection performed by certified inspectors is still the main form of road pothole detection. This process is, however, not only tedious, time-consuming and costly, but also dangerous for the inspectors. Furthermore, the road pothole detection results are always subjective, because they depend entirely on the individual experience. Our recently introduced disparity (or inverse depth) transformation algorithm allows better discrimination between damaged and undamaged road areas, and it can be easily deployed to any semantic segmentation network for better road pothole detection results. To boost the performance, we propose a novel attention aggregation (AA) framework, which takes the advantages of different types of attention modules. In addition, we develop an effective training set augmentation technique based on adversarial domain adaptation, where the synthetic road RGB images and transformed road disparity (or inverse depth) images are generated to enhance the training of semantic segmentation networks. The experimental results demonstrate that, firstly, the transformed disparity (or inverse depth) images become more informative; secondly, AA-UNet and AA-RTFNet, our best performing implementations, respectively outperform all other state-of-the-art single-modal and data-fusion networks for road pothole detection; and finally, the training set augmentation technique based on adversarial domain adaptation not only improves the accuracy of the state-of-the-art semantic segmentation networks, but also accelerates their convergence.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源