论文标题

查看,辐射和学习:通过无线电通信自我监督的本地化

Look, Radiate, and Learn: Self-Supervised Localisation via Radio-Visual Correspondence

论文作者

Alloulah, Mohammed, Arnold, Maximilian

论文摘要

下一代蜂窝网络将与习惯通信一起实施无线电传感功能,从而在户外实现前所未有的全球传感覆盖范围。深度学习彻底改变了计算机视觉,但对无线电感知任务的应用有限,部分原因是缺乏专门研究无线电传感性能和希望的系统数据集和基准。为了解决这一差距,我们提出了MaxRay:合成的视觉数据集和基准,可促进无线电中精确的目标定位。我们进一步建议通过从无线电通信中提取自我协调物来学习在无线电中定位目标。我们使用这种自我监管的坐标来培训无线电网络网络。我们对许多最先进的基线进行了表征。我们的结果表明,可以从配对的无线电数据中自动学习准确的无线电目标定位,而无需标签,这对于经验数据很重要。这为广泛的数据可扩展性打开了大门,并可能证明是在统一的通信感知蜂窝基础架构上实现强大无线电的承诺的关键。数据集将在IEEE DataPort上托管。

Next generation cellular networks will implement radio sensing functions alongside customary communications, thereby enabling unprecedented worldwide sensing coverage outdoors. Deep learning has revolutionised computer vision but has had limited application to radio perception tasks, in part due to lack of systematic datasets and benchmarks dedicated to the study of the performance and promise of radio sensing. To address this gap, we present MaxRay: a synthetic radio-visual dataset and benchmark that facilitate precise target localisation in radio. We further propose to learn to localise targets in radio without supervision by extracting self-coordinates from radio-visual correspondence. We use such self-supervised coordinates to train a radio localiser network. We characterise our performance against a number of state-of-the-art baselines. Our results indicate that accurate radio target localisation can be automatically learned from paired radio-visual data without labels, which is important for empirical data. This opens the door for vast data scalability and may prove key to realising the promise of robust radio sensing atop a unified communication-perception cellular infrastructure. Dataset will be hosted on IEEE DataPort.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源