论文标题
如何民主化和保护AI:公平和差异化的分散深度学习
How to Democratise and Protect AI: Fair and Differentially Private Decentralised Deep Learning
论文作者
论文摘要
本文首先考虑了协作深度学习中的公平性研究问题,同时确保隐私。通过数字代币和当地信誉提出了一种新颖的声誉系统,以确保公平,并结合差异隐私以保证隐私。特别是,我们通过使用我们开发的两阶段方案以公平和私人的方式建立一个名为FDPDDL的公平和差异化的分散深度学习框架,该框架能够以公平和私人的方式得出更准确的本地模型:在初始化阶段,在初始化阶段,人工样本由差异化私人生成性的对抗网络(DPGAN)产生,可用于每种派对的局部派对,并以近距为基础的派对,并以近距离的态度构成了每种派对的初步派对;在更新阶段,差异化私有SGD(DPSGD)用于促进具有协作性隐私的深度学习,并根据单独发布的梯度的质量和数量更新各方的本地信誉和代币。在三个现实设置下的基准数据集上的实验结果表明,FDPDDL达到高公平性,与集中式和分布式框架相当的准确性,并且比独立框架提供了更好的准确性。
This paper firstly considers the research problem of fairness in collaborative deep learning, while ensuring privacy. A novel reputation system is proposed through digital tokens and local credibility to ensure fairness, in combination with differential privacy to guarantee privacy. In particular, we build a fair and differentially private decentralised deep learning framework called FDPDDL, which enables parties to derive more accurate local models in a fair and private manner by using our developed two-stage scheme: during the initialisation stage, artificial samples generated by Differentially Private Generative Adversarial Network (DPGAN) are used to mutually benchmark the local credibility of each party and generate initial tokens; during the update stage, Differentially Private SGD (DPSGD) is used to facilitate collaborative privacy-preserving deep learning, and local credibility and tokens of each party are updated according to the quality and quantity of individually released gradients. Experimental results on benchmark datasets under three realistic settings demonstrate that FDPDDL achieves high fairness, yields comparable accuracy to the centralised and distributed frameworks, and delivers better accuracy than the standalone framework.