论文标题

规范覆盖范围的自适应测试

Adaptive Testing for Specification Coverage

论文作者

Bartocci, Ezio, Bloem, Roderick, Maderbacher, Benedikt, Manjunath, Niveditha, Ničković, Dejan

论文摘要

确保网络物理系统(CPS)的正确性是一项极具挑战性的任务,实际上通常通过基于模拟的测试来解决。正式的规范语言(例如信号时间逻辑(STL))用于数学表达CPS要求,从而使模拟活动更加系统性和原则性。我们提出了一种新型方法,用于自适应生成具有STL规范覆盖率的测试。为了实现这一目标,我们设计了合作可及性游戏,我们将其与数值优化相结合,以创建测试,以行使规范各个部分的方式探索系统。据我们所知,我们的方法是第一种可以直接应用于matlab \ texttrademark \的自适应测试方法。 Simulink/stateFlow模型。我们在原型工具中实施了方法,并在几个说明示例和来自航空电子域的案例研究中对其进行了评估,这证明了自适应测试的有效性(1)逐步构建了达到测试目标的测试案例,(2)生成一个测试套件,生成一个增加规格覆盖率的测试套件,以及(3),(3)推断了规格的哪一部分。

Ensuring correctness of cyber-physical systems (CPS) is an extremely challenging task that is in practice often addressed with simulation based testing. Formal specification languages, such as Signal Temporal Logic (STL), are used to mathematically express CPS requirements and thus render the simulation activity more systematic and principled. We propose a novel method for adaptive generation of tests with specification coverage for STL. To achieve this goal, we devise cooperative reachability games that we combine with numerical optimization to create tests that explore the system in a way that exercise various parts of the specification. To the best of our knowledge our approach is the first adaptive testing approach that can be applied directly to MATLAB\texttrademark\; Simulink/Stateflow models. We implemented our approach in a prototype tool and evaluated it on several illustrating examples and a case study from the avionics domain, demonstrating the effectiveness of adaptive testing to (1) incrementally build a test case that reaches a test objective, (2) generate a test suite that increases the specification coverage, and (3) infer what part of the specification is actually implemented.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源