论文标题

高对比度的“ Gaudy”图像改善了视觉皮层的深神经网络模型的训练

High-contrast "gaudy" images improve the training of deep neural network models of visual cortex

论文作者

Cowley, Benjamin R., Pillow, Jonathan W.

论文摘要

理解视觉系统的感觉转换的主要挑战是从视觉皮质神经元获得高度预测的反应模型。深度神经网络(DNN)为这种模型提供了有前途的候选人。但是,DNN所需的训练数据比神经科学家可以从实际神经元中收集的训练数据多,因为实验记录时间受到严重限制。这促使我们找到具有尽可能少的培训数据的高度预测性DNN的图像。我们提出了谨慎的图像---自然图像的高对比度双核版本 - - 有效地训练DNN。在广泛的模拟实验中,我们发现具有艳丽图像的训练DNN大大减少了准确预测视觉皮质神经元的模拟响应所需的训练图像数量。我们还发现,在训练前选择的谨慎图像优于通过主动学习算法在训练期间选择的图像。因此,谨慎的图像过分强调了自然图像的特征,尤其是边缘,这对于有效训练DNN最重要。我们认为,艳丽的图像将有助于对视觉皮质神经元的建模,有可能打开有关视觉处理的新科学问题,以及寻求方法来改善DNN培训的方法的援助全科医生。

A key challenge in understanding the sensory transformations of the visual system is to obtain a highly predictive model of responses from visual cortical neurons. Deep neural networks (DNNs) provide a promising candidate for such a model. However, DNNs require orders of magnitude more training data than neuroscientists can collect from real neurons because experimental recording time is severely limited. This motivates us to find images that train highly-predictive DNNs with as little training data as possible. We propose gaudy images---high-contrast binarized versions of natural images---to efficiently train DNNs. In extensive simulation experiments, we find that training DNNs with gaudy images substantially reduces the number of training images needed to accurately predict the simulated responses of visual cortical neurons. We also find that gaudy images, chosen before training, outperform images chosen during training by active learning algorithms. Thus, gaudy images overemphasize features of natural images, especially edges, that are the most important for efficiently training DNNs. We believe gaudy images will aid in the modeling of visual cortical neurons, potentially opening new scientific questions about visual processing, as well as aid general practitioners that seek ways to improve the training of DNNs.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源