Transience in countable MDPs

The Transience objective is not to visit any state infinitely often. While this is not possible in any finite Markov Decision Process (MDP), it can be satisfied in countably infinite ones, e.g., if the transition graph is acyclic. We prove the following fundamental properties of Transience in counta...

Full description

Bibliographic Details
Main Authors: Kiefer, SM, Mayr, R, Shirmohammadi, M, Totzke, P
Format: Conference item
Language:English
Published: Schloss Dagstuhl 2021