论文标题
通过拓扑优化加速联合边缘学习
Accelerating Federated Edge Learning via Topology Optimization
论文作者
论文摘要
将联盟的边缘学习(Feel)视为实现隐私保护分布式学习的有前途的范式。但是,由于存在Straggler设备,它会消耗过度学习时间。在本文中,提出了一种新颖的拓扑优化联合边缘学习(TOFEL)方案,以解决联合学习中的异质性问题并提高沟通和兼容效率。具体而言,制定了共同优化聚合拓扑和计算速度的问题,以最大程度地减少能源消耗和延迟的加权总和。为了解决混合企业非线性问题,我们提出了一种新型的基于惩罚的连续凸近近似方法,该方法在轻度条件下会收敛到原始问题的固定点。为了促进实时决策,开发了一种基于模仿学习的方法,其中深层神经网络(DNNS)是离线训练的,以模仿基于罚款的方法,并在边缘设备上部署了训练有素的模仿DNN来进行在线推断。因此,有效模仿基于学习的方法无缝地集成到豆腐框架中。仿真结果表明,所提出的豆腐方案加速了联邦学习过程,并实现了更高的能源效率。此外,我们将该方案应用于Carla模拟器中使用多车点云数据集的3D对象检测。结果证实了托弗尔方案的出色学习表现,而不是具有相同资源和截止日期约束的传统设计。
Federated edge learning (FEEL) is envisioned as a promising paradigm to achieve privacy-preserving distributed learning. However, it consumes excessive learning time due to the existence of straggler devices. In this paper, a novel topology-optimized federated edge learning (TOFEL) scheme is proposed to tackle the heterogeneity issue in federated learning and to improve the communication-and-computation efficiency. Specifically, a problem of jointly optimizing the aggregation topology and computing speed is formulated to minimize the weighted summation of energy consumption and latency. To solve the mixed-integer nonlinear problem, we propose a novel solution method of penalty-based successive convex approximation, which converges to a stationary point of the primal problem under mild conditions. To facilitate real-time decision making, an imitation-learning based method is developed, where deep neural networks (DNNs) are trained offline to mimic the penalty-based method, and the trained imitation DNNs are deployed at the edge devices for online inference. Thereby, an efficient imitate-learning based approach is seamlessly integrated into the TOFEL framework. Simulation results demonstrate that the proposed TOFEL scheme accelerates the federated learning process, and achieves a higher energy efficiency. Moreover, we apply the scheme to 3D object detection with multi-vehicle point cloud datasets in the CARLA simulator. The results confirm the superior learning performance of the TOFEL scheme over conventional designs with the same resource and deadline constraints.