论文标题

Meranet:使用3D残留注意网络的面部微表达识别

MERANet: Facial Micro-Expression Recognition using 3D Residual Attention Network

论文作者

Gajjala, Viswanatha Reddy, Reddy, Sai Prasanna Teja, Mukherjee, Snehasis, Dubey, Shiv Ram

论文摘要

由于情绪检测的高度客观性,微观表达已成为情感计算中的一种有希望的方式。尽管深度学习模型提供了更高的识别精度,但在微表达识别技术方面仍然存在显着的范围。面部小本地区域中的微表达以及可用数据库的有限尺寸继续限制识别微表达的准确性。在这项工作中,我们建议使用名为Meranet的3D残留注意网络提出面部微表达识别模型,以应对此类挑战。提出的模型利用时空的关注和引起人们的注意,以学习更深的细粒度微妙特征,以分类情绪。此外,所提出的模型使用3D内核和剩余连接同时包含空间和时间信息。此外,在每个残留模块中分别使用通道和时空注意力重新校准了通道特征和时空特征。我们的注意机制使该模型能够学会关注不同感兴趣的面部领域。实验是在基准面部微表达数据集上进行的。与基准数据的面部微表达识别相比,观察到卓越的性能。

Micro-expression has emerged as a promising modality in affective computing due to its high objectivity in emotion detection. Despite the higher recognition accuracy provided by the deep learning models, there are still significant scope for improvements in micro-expression recognition techniques. The presence of micro-expressions in small-local regions of the face, as well as the limited size of available databases, continue to limit the accuracy in recognizing micro-expressions. In this work, we propose a facial micro-expression recognition model using 3D residual attention network named MERANet to tackle such challenges. The proposed model takes advantage of spatial-temporal attention and channel attention together, to learn deeper fine-grained subtle features for classification of emotions. Further, the proposed model encompasses both spatial and temporal information simultaneously using the 3D kernels and residual connections. Moreover, the channel features and spatio-temporal features are re-calibrated using the channel and spatio-temporal attentions, respectively in each residual module. Our attention mechanism enables the model to learn to focus on different facial areas of interest. The experiments are conducted on benchmark facial micro-expression datasets. A superior performance is observed as compared to the state-of-the-art for facial micro-expression recognition on benchmark data.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源