论文标题
与实体链接的早期阶段稀疏检索
Early Stage Sparse Retrieval with Entity Linking
论文作者
论文摘要
尽管它们的低资源设置具有优势,但传统的稀疏猎犬仍取决于查询和收藏品的高维单词袋(BOW)表示之间的确切匹配方法。结果,检索性能受到语义差异和词汇差距的限制。另一方面,基于变压器的密集检索员通过利用语料库的低维上下文表示,对信息检索任务进行了重大改进。尽管与稀疏的猎犬相比,虽然密集的猎犬以其相对有效性而闻名,但它们的效率较低和缺乏概括性问题。对于轻巧的检索任务,高计算资源和时间消耗是鼓励放弃密集模型的主要障碍。在这项工作中,我们建议通过以两种格式扩展具有两种格式的实体名称的链接实体的查询和文档来提高稀疏回收者的性能:1)显式和2)哈希。我们采用零射击的端到端密集实体链接系统来实体识别和歧义,以增加语料库。通过利用高级实体链接方法,我们认为可以缩小稀疏和致密检索器之间的有效性差距。我们在MS MARCO通道数据集上进行实验。由于我们关心大型信息检索系统的级联排名架构的早期检索,因此我们使用Reckle@1000评估结果。我们的方法还能够检索判断在先前工作中特别困难的查询子集的文档。我们进一步证明,非扩展和扩展的运行均具有显式和哈希实体取回互补结果。因此,我们采用运行的融合方法来最大程度地提高实体链接的好处。
Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result, retrieval performance is restricted by semantic discrepancies and vocabulary gaps. On the other hand, transformer-based dense retrievers introduce significant improvements in information retrieval tasks by exploiting low-dimensional contextualized representations of the corpus. While dense retrievers are known for their relative effectiveness, they suffer from lower efficiency and lack of generalization issues, when compared to sparse retrievers. For a lightweight retrieval task, high computational resources and time consumption are major barriers encouraging the renunciation of dense models despite potential gains. In this work, we propose boosting the performance of sparse retrievers by expanding both the queries and the documents with linked entities in two formats for the entity names: 1) explicit and 2) hashed. We employ a zero-shot end-to-end dense entity linking system for entity recognition and disambiguation to augment the corpus. By leveraging the advanced entity linking methods, we believe that the effectiveness gap between sparse and dense retrievers can be narrowed. We conduct our experiments on the MS MARCO passage dataset. Since we are concerned with the early stage retrieval in cascaded ranking architectures of large information retrieval systems, we evaluate our results using recall@1000. Our approach is also capable of retrieving documents for query subsets judged to be particularly difficult in prior work. We further demonstrate that the non-expanded and the expanded runs with both explicit and hashed entities retrieve complementary results. Consequently, we adopt a run fusion approach to maximize the benefits of entity linking.