Publication details
Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives
| Basic information | |
|---|---|
| Original title: | Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives |
| Authors: | Tomáš Brázdil, Vojtěch Forejt, Antonín Kučera |
| Further information | |
|---|---|
| Citation: | BRÁZDIL, Tomáš - FOREJT, Vojtěch - KUČERA, Antonín. Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives. In Automata, Languages and Programming. 35th International Colloquium, ICALP 2008. Reykjavik, Iceland, July 2008. Proceedings, Part II. Berlin, Heidelberg, New York : Springer, 2008. ISBN 3 -540 -70582 -1, pp. 148 -159. 7.7.2008, Reykjavik, Iceland. |
| Original language: | English |
| Field: | Informatika |
| Type: | Article in Proceedings |
| Keywords: | Markov decision processes; Probabilistic Temporal Logics |
We show that the controller synthesis and verification problems for Markov decision processes with qualitative PECTL* objectives are 2-EXPTIME complete. More precisely, the algorithms are polynomial in the size of a given Markov decision process and doubly exponential in the size of a given qualitative PECTL* formula. Moreover, we show that if a given qualitative PECTL* objective is achievable by some strategy, then it is also achievable by an effectively constructible one-counter strategy, where the associated complexity bounds are essentially the same as above. For the fragment of qualitative PCTL objectives, we obtain EXPTIME completeness and the algorithms are only singly exponential in the size of the formula.
Related projects:
- Integrated approach to education of PhD students in the area of parallel and distributed systems
- Institute for Theoretical Computer Science
- Highly Parallel and Distributed Computing Systems











