论文标题
与实例依赖性噪声的强大产品分类
Robust Product Classification with Instance-Dependent Noise
论文作者
论文摘要
大型电子商务产品数据中的嘈杂标签(即将产品项放入错误类别)是产品分类任务的关键问题,因为它们是不可避免的,不足以显着删除和降低预测性能。培训数据中对数据中嘈杂标签的产品标题分类模型对于使产品分类应用程序更加实用非常重要。在本文中,我们通过比较我们的数据降低算法和不同的噪声抗性训练算法来研究实例依赖性噪声对产品标题分类的性能的影响,这些算法旨在防止分类器模型过度拟合到噪声。我们开发了一个简单而有效的深度神经网络,用于将产品标题分类用作基本分类器。除了刺激实例依赖性噪声的最新方法外,我们还提出了一种基于产品标题相似性的新型噪声刺激算法。我们的实验涵盖了多个数据集,各种噪声方法和不同的训练解决方案。当噪声速率不容易忽略时,结果发现分类任务的限制并且数据分布高度偏斜。
Noisy labels in large E-commerce product data (i.e., product items are placed into incorrect categories) are a critical issue for product categorization task because they are unavoidable, non-trivial to remove and degrade prediction performance significantly. Training a product title classification model which is robust to noisy labels in the data is very important to make product classification applications more practical. In this paper, we study the impact of instance-dependent noise to performance of product title classification by comparing our data denoising algorithm and different noise-resistance training algorithms which were designed to prevent a classifier model from over-fitting to noise. We develop a simple yet effective Deep Neural Network for product title classification to use as a base classifier. Along with recent methods of stimulating instance-dependent noise, we propose a novel noise stimulation algorithm based on product title similarity. Our experiments cover multiple datasets, various noise methods and different training solutions. Results uncover the limit of classification task when noise rate is not negligible and data distribution is highly skewed.