论文标题
通过语义变化检测时间的自动编码单词表示形式
Autoencoding Word Representations through Time for Semantic Change Detection
论文作者
论文摘要
语义变化检测涉及识别含义随时间变化的单词的任务。当前的最新面临通过在两个不同的时间段中比较其向量表示,检测到单词的语义变化水平,而无需考虑其随时间的发展。在这项工作中,我们提出了三种顺序模型的变体,用于检测语义转移的单词,以时间敏感的方式有效地考虑了随时间的变化。通过合成和真实数据的各种设置下的广泛实验,我们展示了单词向量的顺序建模的重要性。最后,我们朝着以定量方式比较不同的方法迈出了一步,这表明单词表示的时间建模在性能方面具有明显的优势。
Semantic change detection concerns the task of identifying words whose meaning has changed over time. The current state-of-the-art detects the level of semantic change in a word by comparing its vector representation in two distinct time periods, without considering its evolution through time. In this work, we propose three variants of sequential models for detecting semantically shifted words, effectively accounting for the changes in the word representations over time, in a temporally sensitive manner. Through extensive experimentation under various settings with both synthetic and real data we showcase the importance of sequential modelling of word vectors through time for detecting the words whose semantics have changed the most. Finally, we take a step towards comparing different approaches in a quantitative manner, demonstrating that the temporal modelling of word representations yields a clear-cut advantage in performance.