论文标题
当无线通信符合5G以上的计算机视觉
When Wireless Communications Meet Computer Vision in Beyond 5G
论文作者
论文摘要
本文阐明了坐在计算机视觉和无线通信汇合处的新兴范式,以超越5G/6G任务至关重要的应用程序(自动/遥控车辆,Visuo-Haptic VR,Visuo-Haptic VR和其他网络物理应用程序)。首先,借鉴机器学习的最新进展和非RF数据的可用性,视觉辅助的无线网络被证明可显着提高无线通信的可靠性,而无需牺牲光谱效率。特别是,我们演示了计算机视觉如何启用{look-head}在毫米波频道阻滞方案中的预测,然后才能真正发生阻塞。从计算机视觉的角度来看,我们强调了基于射频(RF)的感应和成像如何有助于鲁棒化计算机视觉应用,以防止遮挡和故障。这是通过基于RF的图像重建用例来证实的,展示了接收器端图像故障校正,从而减少了重新启动和延迟。综上所述,本文阐明了RF和非RF模式的急需的融合,以实现超可靠的通信和真正智能的6G网络。
This article articulates the emerging paradigm, sitting at the confluence of computer vision and wireless communication, to enable beyond-5G/6G mission-critical applications (autonomous/remote-controlled vehicles, visuo-haptic VR, and other cyber-physical applications). First, drawing on recent advances in machine learning and the availability of non-RF data, vision-aided wireless networks are shown to significantly enhance the reliability of wireless communication without sacrificing spectral efficiency. In particular, we demonstrate how computer vision enables {look-ahead} prediction in a millimeter-wave channel blockage scenario, before the blockage actually happens. From a computer vision perspective, we highlight how radio frequency (RF) based sensing and imaging are instrumental in robustifying computer vision applications against occlusion and failure. This is corroborated via an RF-based image reconstruction use case, showcasing a receiver-side image failure correction resulting in reduced retransmission and latency. Taken together, this article sheds light on the much-needed convergence of RF and non-RF modalities to enable ultra-reliable communication and truly intelligent 6G networks.