论文标题

深度衍射神经网络的单一学习

Unitary Learning for Deep Diffractive Neural Network

论文作者

Xiao, Yong-Liang

论文摘要

如今,以连贯的衍射实现深度学习已经取得了显着的发展,这是因为可以在矩阵乘法下可以在矩阵乘法下并平行执行矩阵乘法,而且几乎没有功耗。以复杂值实体的形式传播的相干光场可以通过统计推断为以任务为导向的输出。在本文中,我们介绍了关于深层衍射神经网络的统一学习方案,在相干衍射中符合物理统一的事先。统一学习是一种通过欧几里得和里曼尼亚空间之间的梯度翻译来更新统一权重的反向传播。统一学习中的时间空间演变特征是制定和阐明的。特别是关于如何在复杂空间中选择非线性激活的兼容条件,已揭幕,将基本的Sigmoid,Tanh和Quasi-Relu封装在复杂空间中。作为初步应用,在2D分类和验证任务上暂时实施了具有单一学习的深层衍射神经网络。

Realization of deep learning with coherent diffraction has achieved remarkable development nowadays, which benefits on the fact that matrix multiplication can be optically executed in parallel as well as with little power consumption. Coherent optical field propagated in the form of complex-value entity can be manipulated into a task-oriented output with statistical inference. In this paper, we present a unitary learning protocol on deep diffractive neural network, meeting the physical unitary prior in coherent diffraction. Unitary learning is a backpropagation serving to unitary weights update through the gradient translation between Euclidean and Riemannian space. The temporal-space evolution characteristic in unitary learning is formulated and elucidated. Particularly a compatible condition on how to select the nonlinear activations in complex space is unveiled, encapsulating the fundamental sigmoid, tanh and quasi-ReLu in complex space. As a preliminary application, deep diffractive neural network with unitary learning is tentatively implemented on the 2D classification and verification tasks.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源