论文标题
食物:快速分发检测器
FOOD: Fast Out-Of-Distribution Detector
论文作者
论文摘要
深度神经网络(DNN)在分类与已训练的类别相关的输入方面表现良好,这些输入称为分布输入中。但是,分布(OOD)的输入对DNN构成了巨大挑战,因此在安全至关重要的系统中实施DNN时,代表了主要风险。在OOD检测领域进行了广泛的研究。但是,当前用于OOD检测的最新方法至少受到以下局限性之一:(1)推理时间增加 - 这限制了现有方法对许多现实世界应用的适用性,以及(2)对OOD培训数据的需求 - 此类数据可能难以获取并且可能不够代表性,从而限制了OOD检测器的能力来探测能够进行一般化。在本文中,我们提出了食物 - 快速分发检测器 - 扩展的DNN分类器,能够有效地检测具有最小推理时间开销的OOD样品。我们的架构具有最终高斯层的DNN,并结合了对数可能性比率统计测试和用于OOD检测的额外输出神经元。我们不使用真实的OOD数据,而是使用一种新颖的方法来制作分布数据中的人造OOD样品,这些数据用于训练我们的OOD检测器神经元。我们评估食品在SVHN,CIFAR-10和CIFAR-100数据集上的检测性能。我们的结果表明,除了实现最先进的性能外,食物还快速适用于现实世界应用。
Deep neural networks (DNNs) perform well at classifying inputs associated with the classes they have been trained on, which are known as in distribution inputs. However, out-of-distribution (OOD) inputs pose a great challenge to DNNs and consequently represent a major risk when DNNs are implemented in safety-critical systems. Extensive research has been performed in the domain of OOD detection. However, current state-of-the-art methods for OOD detection suffer from at least one of the following limitations: (1) increased inference time - this limits existing methods' applicability to many real-world applications, and (2) the need for OOD training data - such data can be difficult to acquire and may not be representative enough, thus limiting the ability of the OOD detector to generalize. In this paper, we propose FOOD -- Fast Out-Of-Distribution detector -- an extended DNN classifier capable of efficiently detecting OOD samples with minimal inference time overhead. Our architecture features a DNN with a final Gaussian layer combined with the log likelihood ratio statistical test and an additional output neuron for OOD detection. Instead of using real OOD data, we use a novel method to craft artificial OOD samples from in-distribution data, which are used to train our OOD detector neuron. We evaluate FOOD's detection performance on the SVHN, CIFAR-10, and CIFAR-100 datasets. Our results demonstrate that in addition to achieving state-of-the-art performance, FOOD is fast and applicable to real-world applications.