论文标题
任务:基于变压器的对抗性学习,用于使用可穿戴传感器通过自我知识蒸馏的人类活动识别
TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation
论文作者
论文摘要
基于可穿戴传感器的人类活动识别(HAR)已成为主要研究领域,并用于多种应用中。最近,随着人类计算机相互作用应用的发展,基于深度学习的方法在HAR领域取得了重大改进。但是,它们仅限于在标准卷积神经网络的过程中在当地社区运行,并且忽略了身体位置上不同传感器之间的相关性。此外,由于培训和测试数据的分布以及受试者之间的行为差异,由于较大的差距,他们仍然面临着巨大的挑战性问题。在这项工作中,我们提出了一个新型的基于变压器的对抗性学习框架,用于通过自我知识蒸馏(任务)使用可穿戴传感器识别人类活动的识别,以说明单个传感器方向以及空间和时间特征。所提出的方法能够使用对抗性学习和最大平均差异(MMD)正则化来学习来自多个受试者数据集的跨域嵌入特征表示,以使数据分布在多个域上对齐。在拟议的方法中,我们采用无教师的自我知识蒸馏来提高训练程序的稳定性和人类活动识别的表现。实验结果表明,任务不仅在四个现实世界公共HAR数据集(单独或合并)上胜过最先进的方法,而且还可以有效地改善主题的概括。
Wearable sensor-based human activity recognition (HAR) has emerged as a principal research area and is utilized in a variety of applications. Recently, deep learning-based methods have achieved significant improvement in the HAR field with the development of human-computer interaction applications. However, they are limited to operating in a local neighborhood in the process of a standard convolution neural network, and correlations between different sensors on body positions are ignored. In addition, they still face significant challenging problems with performance degradation due to large gaps in the distribution of training and test data, and behavioral differences between subjects. In this work, we propose a novel Transformer-based Adversarial learning framework for human activity recognition using wearable sensors via Self-KnowledgE Distillation (TASKED), that accounts for individual sensor orientations and spatial and temporal features. The proposed method is capable of learning cross-domain embedding feature representations from multiple subjects datasets using adversarial learning and the maximum mean discrepancy (MMD) regularization to align the data distribution over multiple domains. In the proposed method, we adopt the teacher-free self-knowledge distillation to improve the stability of the training procedure and the performance of human activity recognition. Experimental results show that TASKED not only outperforms state-of-the-art methods on the four real-world public HAR datasets (alone or combined) but also improves the subject generalization effectively.