论文标题
使用增强学习的数据驱动的稳健控制
Data-Driven Robust Control Using Reinforcement Learning
论文作者
论文摘要
本文提出了一种强大的控制设计方法,使用加强学习方法来控制不确定条件下部分不确定的动态系统。该方法通过基于强大的控制理论的新学习技术扩展了最佳的增强学习算法。通过从数据中学习,算法提出的操作可以保证在数据中估计的不确定性中封闭循环系统的稳定性。控制策略是通过解决一组线性基质不等式来计算的。使用对1型糖尿病患者的血糖模型上的模拟对控制器进行评估。仿真结果表明,在测量和过程噪声的影响下,所提出的方法能够在健康水平内安全地调节血糖。控制器还显着降低了血糖后光后波动。所提出的算法与现有的最佳增强学习算法之间的比较表明,使用我们的方法,闭环系统的鲁棒性得到了改善。
This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new learning technique that is based on the robust control theory. By learning from the data, the algorithm proposed actions that guarantees the stability of the closed loop system within the uncertainties estimated from the data. Control policies are calculated by solving a set of linear matrix inequalities. The controller was evaluated using simulations on a blood glucose model for patients with type-1 diabetes. Simulation results show that the proposed methodology is capable of safely regulates the blood glucose within a healthy level under the influence of measurement and process noises. The controller has also significantly reduced the post-meal fluctuation of the blood glucose. A comparison between the proposed algorithm and the existing optimal reinforcement learning algorithm shows the improved robustness of the closed loop system using our method.