论文标题

DFEW:一个大规模数据库,用于识别野外动态面部表情

DFEW: A Large-Scale Database for Recognizing Dynamic Facial Expressions in the Wild

论文作者

Jiang, Xingxun, Zong, Yuan, Zheng, Wenming, Tang, Chuangao, Xia, Wanchuang, Lu, Cheng, Liu, Jiateng

论文摘要

最近,野外的面部表情识别(FER)引起了许多研究人员的关注,因为它是一个有价值的主题,可以使FER技术从实验室转移到实际应用。在本文中,我们专注于这个具有挑战性但有趣的话题,并从三个方面做出了贡献。首先,我们提出了一个新的大型“野外”动态面部表达数据库DFEW(野外动态面部表情),其中包括数千个电影的16,000多个视频剪辑。这些视频剪辑在实践场景中包含各种具有挑战性的干扰,例如极端照明,遮挡和反复无常的姿势变化。其次,我们提出了一种新的方法,称为表达簇的时空特征学习(EC-STFL)框架,以处理野外动态FER。第三,我们使用许多时空深度学习方法以及我们提出的EC-STFL进行了DFEW的广泛基准实验。实验结果表明,DFEW是一个精心设计且具有挑战性的数据库,拟议的EC-STFL可以有希望改善现有时空深神经网络的性能,以应对野外动态FER的问题。我们的DFEW数据库已公开可用,可以从https://dfew-dataset.github.io/免费下载。

Recently, facial expression recognition (FER) in the wild has gained a lot of researchers' attention because it is a valuable topic to enable the FER techniques to move from the laboratory to the real applications. In this paper, we focus on this challenging but interesting topic and make contributions from three aspects. First, we present a new large-scale 'in-the-wild' dynamic facial expression database, DFEW (Dynamic Facial Expression in the Wild), consisting of over 16,000 video clips from thousands of movies. These video clips contain various challenging interferences in practical scenarios such as extreme illumination, occlusions, and capricious pose changes. Second, we propose a novel method called Expression-Clustered Spatiotemporal Feature Learning (EC-STFL) framework to deal with dynamic FER in the wild. Third, we conduct extensive benchmark experiments on DFEW using a lot of spatiotemporal deep feature learning methods as well as our proposed EC-STFL. Experimental results show that DFEW is a well-designed and challenging database, and the proposed EC-STFL can promisingly improve the performance of existing spatiotemporal deep neural networks in coping with the problem of dynamic FER in the wild. Our DFEW database is publicly available and can be freely downloaded from https://dfew-dataset.github.io/.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源