论文标题
用于评估数据到文本系统准确性的黄金标准方法
A Gold Standard Methodology for Evaluating Accuracy in Data-To-Text Systems
论文作者
论文摘要
大多数自然语言生成系统都需要产生准确的文本。我们提出了一种对生成文本准确性的高质量人类评估的方法，该方法旨在作为数据到文本系统的准确评估的金标准。我们使用我们的方法来评估计算机生成的篮球摘要的准确性。然后，我们展示如何使用黄金标准评估来验证自动指标
Most Natural Language Generation systems need to produce accurate texts. We propose a methodology for high-quality human evaluation of the accuracy of generated texts, which is intended to serve as a gold-standard for accuracy evaluations of data-to-text systems. We use our methodology to evaluate the accuracy of computer generated basketball summaries. We then show how our gold standard evaluation can be used to validate automated metrics
