论文标题

通过拓扑优化加速联合边缘学习

Accelerating Federated Edge Learning via Topology Optimization

论文作者

Huang, Shanfeng, Zhang, Zezhong, Wang, Shuai, Wang, Rui, Huang, Kaibin

论文摘要

将联盟的边缘学习(Feel)视为实现隐私保护分布式学习的有前途的范式。但是,由于存在Straggler设备,它会消耗过度学习时间。在本文中,提出了一种新颖的拓扑优化联合边缘学习(TOFEL)方案,以解决联合学习中的异质性问题并提高沟通和兼容效率。具体而言,制定了共同优化聚合拓扑和计算速度的问题,以最大程度地减少能源消耗和延迟的加权总和。为了解决混合企业非线性问题,我们提出了一种新型的基于惩罚的连续凸近近似方法,该方法在轻度条件下会收敛到原始问题的固定点。为了促进实时决策,开发了一种基于模仿学习的方法,其中深层神经网络(DNNS)是离线训练的,以模仿基于罚款的方法,并在边缘设备上部署了训练有素的模仿DNN来进行在线推断。因此,有效模仿基于学习的方法无缝地集成到豆腐框架中。仿真结果表明,所提出的豆腐方案加速了联邦学习过程,并实现了更高的能源效率。此外,我们将该方案应用于Carla模拟器中使用多车点云数据集的3D对象检测。结果证实了托弗尔方案的出色学习表现,而不是具有相同资源和截止日期约束的传统设计。

Federated edge learning (FEEL) is envisioned as a promising paradigm to achieve privacy-preserving distributed learning. However, it consumes excessive learning time due to the existence of straggler devices. In this paper, a novel topology-optimized federated edge learning (TOFEL) scheme is proposed to tackle the heterogeneity issue in federated learning and to improve the communication-and-computation efficiency. Specifically, a problem of jointly optimizing the aggregation topology and computing speed is formulated to minimize the weighted summation of energy consumption and latency. To solve the mixed-integer nonlinear problem, we propose a novel solution method of penalty-based successive convex approximation, which converges to a stationary point of the primal problem under mild conditions. To facilitate real-time decision making, an imitation-learning based method is developed, where deep neural networks (DNNs) are trained offline to mimic the penalty-based method, and the trained imitation DNNs are deployed at the edge devices for online inference. Thereby, an efficient imitate-learning based approach is seamlessly integrated into the TOFEL framework. Simulation results demonstrate that the proposed TOFEL scheme accelerates the federated learning process, and achieves a higher energy efficiency. Moreover, we apply the scheme to 3D object detection with multi-vehicle point cloud datasets in the CARLA simulator. The results confirm the superior learning performance of the TOFEL scheme over conventional designs with the same resource and deadline constraints.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源