论文标题

NNRearch:针对神经网络体系结构的张量计划调度框架逆向工程

NNReArch: A Tensor Program Scheduling Framework Against Neural Network Architecture Reverse Engineering

论文作者

Luo, Yukui, Duan, Shijin, Gongye, Cheng, Fei, Yunsi, Xu, Xiaolin

论文摘要

架构逆向工程已成为对深神经网络(DNN)实现的新兴攻击。在目标加速平台上执行目标时,几项先前的工作利用了侧通道泄漏来恢复模型体系结构。在这项工作中,我们针对开源深度学习加速器,多功能张量加速器(VTA),并利用电磁(EM)侧向通道泄漏,以全面了解DNN结构构型和EM散发之间的关联。我们还考虑了整体系统 - 包括Xilinx FPGA上VTA加速器的低级张量程序代码,并探索此类低级配置对EM泄漏的影响。我们的研究表明,张量程序的优化和配置都会影响EM侧通道泄漏。 我们提出了针对基于侧渠道的DNN模型体系结构逆向工程的轻量级张量程序调度框架NNRearch的知识,我们提出了NNRearch,这是一个轻巧的张量程序调度框架。具体而言,NNRearch通过安排DNN模型的张量程序执行来重塑不同DNN运算符的EM痕迹,以使对手混淆。 NNRearch是支持两种模式的全面保护框架,一种平衡模式,在DNN模型机密性和执行性能之间达到平衡,以及选择最安全的设置的安全模式。我们使用最先进的DNN体系结构在开源VTA上实施并评估所提出的框架。实验结果表明,NNRearch可以通过较小的性能开销有效地增强模型体系结构安全性。此外,提出的混淆技术使DNN体系结构的反向工程更加困难。

Architecture reverse engineering has become an emerging attack against deep neural network (DNN) implementations. Several prior works have utilized side-channel leakage to recover the model architecture while the target is executing on a hardware acceleration platform. In this work, we target an open-source deep-learning accelerator, Versatile Tensor Accelerator (VTA), and utilize electromagnetic (EM) side-channel leakage to comprehensively learn the association between DNN architecture configurations and EM emanations. We also consider the holistic system -- including the low-level tensor program code of the VTA accelerator on a Xilinx FPGA and explore the effect of such low-level configurations on the EM leakage. Our study demonstrates that both the optimization and configuration of tensor programs will affect the EM side-channel leakage. Gaining knowledge of the association between the low-level tensor program and the EM emanations, we propose NNReArch, a lightweight tensor program scheduling framework against side-channel-based DNN model architecture reverse engineering. Specifically, NNReArch targets reshaping the EM traces of different DNN operators, through scheduling the tensor program execution of the DNN model so as to confuse the adversary. NNReArch is a comprehensive protection framework supporting two modes, a balanced mode that strikes a balance between the DNN model confidentiality and execution performance, and a secure mode where the most secure setting is chosen. We implement and evaluate the proposed framework on the open-source VTA with state-of-the-art DNN architectures. The experimental results demonstrate that NNReArch can efficiently enhance the model architecture security with a small performance overhead. In addition, the proposed obfuscation technique makes reverse engineering of the DNN architecture significantly harder.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源