Optimal Control of MDPs with Temporal Logic Constraints

Autoři SVOREŇOVÁ Mária — ČERNÁ Ivana — BELTA Calin
Druh Článek ve sborníku
Citace SVOREŇOVÁ, Mária, Ivana ČERNÁ a Calin BELTA. Optimal Control of MDPs with Temporal Logic Constraints. In Proceedings of The 52nd IEEE Conference on Decision and Control. Neuveden: Omnipress for the IEEE Control Systems Society, 2013. s. 3938-3943, 6 s. ISBN 978-1-4673-5714-2. doi:10.1109/CDC.2013.6760491.
Originální jazyk angličtina
Obor Informatika
WWW http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6760491
Doi http://dx.doi.org/10.1109/CDC.2013.6760491
Klíčová slova automatic synthesis Markov decision processes LTL

In this paper, we focus on formal synthesis of control policies for finite Markov decision processes with non-negative real-valued costs. We develop an algorithm to automatically generate a policy that guarantees the satisfaction of a correctness specification expressed as a formula of Linear Temporal Logic, while at the same time minimizing the expected average cost between two consecutive satisfactions of a desired property. The existing solutions to this problem are sub-optimal. By leveraging ideas from automata-based model checking and game theory, we provide an optimal solution. We demonstrate the approach on an illustrative example.

Související projekty:

Používáte starou verzi internetového prohlížeče. Doporučujeme aktualizovat Váš prohlížeč na nejnovější verzi.

Další info