Publication details

Efficient Analysis of Probabilistic Programs with an Unbounded Counter

Authors

BRÁZDIL Tomáš KIEFER Stefan KUČERA Antonín

Year of publication 2014
Type Article in Periodical
Magazine / Source Journal of the ACM
MU Faculty or unit

Faculty of Informatics

Citation
Doi http://dx.doi.org/10.1145/2629599
Field Informatics
Keywords Markov chains; model-checking; one-counter automata
Description We show that a subclass of infinite-state probabilistic programs that can be modeled by probabilistic one-counter automata (pOC) admits an efficient quantitative analysis. We start by establishing a powerful link between pOC and martingale theory, which leads to fundamental observations about quantitative properties of runs in pOC. In particular, we provide a “divergence gap theorem”, which bounds a positive non-termination probability in pOC away from zero. Using these observations, we show that the expected termination time can be approximated up to an arbitrarily small relative error in polynomial time, and the same holds for the probability of all runs that satisfy a given omega-regular property encoded by a deterministic Rabin automaton.
Related projects: