Transience in countable MDPs
The Transience objective is not to visit any state infinitely often. While this is not possible in any finite Markov Decision Process (MDP), it can be satisfied in countably infinite ones, e.g., if the transition graph is acyclic. We prove the following fundamental properties of Transience in counta...
Main Authors: | Kiefer, SM, Mayr, R, Shirmohammadi, M, Totzke, P |
---|---|
Format: | Conference item |
Language: | English |
Published: |
Schloss Dagstuhl
2021
|
Similar Items
-
Büchi objectives in countable MDPs
by: Kiefer, S, et al.
Published: (2019) -
Strategy complexity of parity objectives in countable MDPs
by: Kiefer, S, et al.
Published: (2020) -
Parity objectives in countable MDPs
by: Kiefer, S, et al.
Published: (2017) -
Strategy complexity of reachability in countable stochastic 2-player games
by: Kiefer, S, et al.
Published: (2024) -
On strong determinacy of countable stochastic games
by: Kiefer, S, et al.
Published: (2017)