论文标题
在设备上分布的联合学习系统的多资源分配
Multi-Resource Allocation for On-Device Distributed Federated Learning Systems
论文作者
论文摘要
这项工作构成了分布式的多资源分配方案,用于最大程度地减少在设备分布的联合学习(FL)系统中的延迟和能量消耗的加权总和。系统中的每个移动设备都会在指定区域内参与模型培训过程,并分别分别分配其计算和通信资源,以分别得出和上传参数,以最大程度地降低按计算/通信预算和目标延迟要求的系统的目标。特别是,移动设备通过无线TCP/IP体系结构进行连接。利用优化问题结构,可以将问题分解为两个凸子问题。利用Lagrangian双重和和谐搜索技术,我们通过对所有子问题的封闭式解决方案来表征全球最佳解决方案,这些解决方案为多资源折衷提供了定性的见解。数值模拟用于验证分析和评估所提出算法的性能。
This work poses a distributed multi-resource allocation scheme for minimizing the weighted sum of latency and energy consumption in the on-device distributed federated learning (FL) system. Each mobile device in the system engages the model training process within the specified area and allocates its computation and communication resources for deriving and uploading parameters, respectively, to minimize the objective of system subject to the computation/communication budget and a target latency requirement. In particular, mobile devices are connect via wireless TCP/IP architectures. Exploiting the optimization problem structure, the problem can be decomposed to two convex sub-problems. Drawing on the Lagrangian dual and harmony search techniques, we characterize the global optimal solution by the closed-form solutions to all sub-problems, which give qualitative insights to multi-resource tradeoff. Numerical simulations are used to validate the analysis and assess the performance of the proposed algorithm.