论文标题

NNLANDER-VERIF:基于视觉的自动驾驶飞机着陆的神经网络正式验证框架

NNLander-VeriF: A Neural Network Formal Verification Framework for Vision-Based Autonomous Aircraft Landing

论文作者

Cruz, Ulices Santa, Shoukry, Yasser

论文摘要

在本文中,我们考虑了正式验证基于神经网络(NN)的自动着陆系统的问题。在这样的系统中,NN控制器从相机处理图像,以指导飞机接近跑道。对基于视觉的闭环系统的安全性验证的核心挑战是缺乏捕获系统状态(例如飞机位置)和基于视觉NN控制器处理的图像之间关系的数学模型。另一个挑战是最先进的NN模型检查器的能力有限。此类模型检查器只能对神经网络的简单输入输出鲁棒性属性进行推论。此限制在NN模型检查器的能力和考虑飞机动力学,感知组件和NN控制器的同时验证闭环系统的需求之间会造成差距。为此,本文介绍了Nnlander-Verif,该框架是验证用于自动登陆的基于视觉的NN控制器的框架。 NNLANDER-VERIF通过利用透视摄像机的几何模型来获得上述挑战,以获得数学模型,该模型捕获飞机状态与NN控制器的输入之间的关系。通过将该模型转换为NN(手动分配的权重)并将其与NN控制器组成,可以使用一个增强的NN捕获飞机状态和控制动作之间的关系。这种增强的NN模型将闭环验证的自然编码变成了几个NN稳健性查询,最先进的NN模型检查器可以处理哪些查询。最后,我们评估了我们的框架,以正式验证训练有素的NN的性质,并显示其效率。

In this paper, we consider the problem of formally verifying a Neural Network (NN) based autonomous landing system. In such a system, a NN controller processes images from a camera to guide the aircraft while approaching the runway. A central challenge for the safety and liveness verification of vision-based closed-loop systems is the lack of mathematical models that captures the relation between the system states (e.g., position of the aircraft) and the images processed by the vision-based NN controller. Another challenge is the limited abilities of state-of-the-art NN model checkers. Such model checkers can reason only about simple input-output robustness properties of neural networks. This limitation creates a gap between the NN model checker abilities and the need to verify a closed-loop system while considering the aircraft dynamics, the perception components, and the NN controller. To this end, this paper presents NNLander-VeriF, a framework to verify vision-based NN controllers used for autonomous landing. NNLander-VeriF addresses the challenges above by exploiting geometric models of perspective cameras to obtain a mathematical model that captures the relation between the aircraft states and the inputs to the NN controller. By converting this model into a NN (with manually assigned weights) and composing it with the NN controller, one can capture the relation between aircraft states and control actions using one augmented NN. Such an augmented NN model leads to a natural encoding of the closed-loop verification into several NN robustness queries, which state-of-the-art NN model checkers can handle. Finally, we evaluate our framework to formally verify the properties of a trained NN and we show its efficiency.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源