Synchronizing Objectives for Markov Decision Processes

We introduce synchronizing objectives for Markov decision processes (MDP). Intuitively, a synchronizing objective requires that eventually, at every step there is a state which concentrates almost all the probability mass. In particular, it implies that the probabilistic system behaves in the long r...

Full description

Bibliographic Details
Main Authors: Mahsa Shirmohammadi, Laurent Doyen, Thierry Massart
Format: Article
Language:English
Published: Open Publishing Association 2011-02-01
Series:Electronic Proceedings in Theoretical Computer Science
Online Access:http://arxiv.org/pdf/1102.4121v1