论文标题

Au-Air:用于低海拔交通监视的多模式无人机数据集

AU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillance

论文作者

Bozcan, Ilker, Kayacan, Erdal

论文摘要

带有安装相机的无人机(UAV)具有捕获空中(鸟类视图)图像的优势。空中视觉数据的可用性以及对象检测算法的最新进展,导致计算机视觉社区专注于航空图像上的对象检测任务。因此,已经引入了几个空中数据集,包括带有对象注释的视觉数据。在这些数据集中,无人机仅用作飞行式面包室,丢弃有关飞行的不同数据类型(例如,时间,位置,内部传感器)。在这项工作中,我们提出了一个具有多模式传感器数据(即视觉,时间,位置,高度,IMU,速度)的多功能航空数据集(AU-AIR)。 AU-AIR数据集包括从记录的RGB视频中提取的帧元数据(即与流量相关对象类别的边界框注释)。此外,我们强调在对象检测任务的背景下自然图像和空中图像之间的差异。为此,我们在AU-AIR数据集上训练和测试移动对象检测器(包括Yolov3-tiny和Mobilenetv2-Ssdlite),这些数据集适用于使用带有无人机的板载计算机实时对象检测。由于我们的数据集在记录的数据类型中具有多样性,因此它有助于填补计算机视觉和机器人技术之间的差距。该数据集可在https://bozcani.github.io/auairdataset上找到。

Unmanned aerial vehicles (UAVs) with mounted cameras have the advantage of capturing aerial (bird-view) images. The availability of aerial visual data and the recent advances in object detection algorithms led the computer vision community to focus on object detection tasks on aerial images. As a result of this, several aerial datasets have been introduced, including visual data with object annotations. UAVs are used solely as flying-cameras in these datasets, discarding different data types regarding the flight (e.g., time, location, internal sensors). In this work, we propose a multi-purpose aerial dataset (AU-AIR) that has multi-modal sensor data (i.e., visual, time, location, altitude, IMU, velocity) collected in real-world outdoor environments. The AU-AIR dataset includes meta-data for extracted frames (i.e., bounding box annotations for traffic-related object category) from recorded RGB videos. Moreover, we emphasize the differences between natural and aerial images in the context of object detection task. For this end, we train and test mobile object detectors (including YOLOv3-Tiny and MobileNetv2-SSDLite) on the AU-AIR dataset, which are applicable for real-time object detection using on-board computers with UAVs. Since our dataset has diversity in recorded data types, it contributes to filling the gap between computer vision and robotics. The dataset is available at https://bozcani.github.io/auairdataset.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源