Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives.

Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives.

We show that the controller synthesis and verification problems for Markov decision processes with qualitative PECTL* objectives are 2-EXPTIME complete. More precisely, the algorithms are polynomial in the size of a given Markov decision process and doubly exponential in the size of a given qualitat...

Fuld beskrivelse

Bibliografiske detaljer
Main Authors:	Brázdil, T, Forejt, V, Kucera, A
Andre forfattere:	Aceto, L
Format:	Journal article
Sprog:	English
Udgivet:	Springer 2008

Lignende værker

Markov Decision Processes with Multiple Long-run Average Objectives
af: Brázdil, T, et al.
Udgivet: (2011)

Reachability in recursive Markov decision processes.
af: Brázdil, T, et al.
Udgivet: (2008)

Markov Decision Processes with Multiple Long-run Average Objectives
af: Tomáš Brázdil, et al.
Udgivet: (2014-02-01)

Trading Performance for Stability in Markov Decision Processes
af: Brázdil, T, et al.
Udgivet: (2013)

Trading performance for stability in Markov decision processes
af: Brazdil, T, et al.
Udgivet: (2016)

Branching-Time Model-Checking of Probabilistic Pushdown Automata.
af: Brázdil, T, et al.
Udgivet: (2009)

Continuous-Time Stochastic Games with Time-Bounded Reachability.
af: Brázdil, T, et al.
Udgivet: (2009)

Multi-objective robust strategy synthesis for Interval Markov decision processes
af: Hahn, E, et al.
Udgivet: (2017)

Life is Random, Time is Not: Markov Decision Processes with Window Objectives
af: Thomas Brihaye, et al.
Udgivet: (2020-12-01)

Synchronizing Objectives for Markov Decision Processes
af: Mahsa Shirmohammadi, et al.
Udgivet: (2011-02-01)

The Satisfiability Problem for Probabilistic CTL.
af: Brázdil, T, et al.
Udgivet: (2008)

Stability in graphs and games
af: Brázdil, T, et al.
Udgivet: (2016)

Quantitative Multi-objective Verification for Probabilistic Systems.
af: Forejt, V, et al.
Udgivet: (2011)

MULTI-OBJECTIVE MODEL CHECKING OF MARKOV DECISION PROCESSES
af: Etessami, K, et al.
Udgivet: (2008)

Multi-Objective Model Checking of Markov Decision Processes
af: Kousha Etessami, et al.
Udgivet: (2008-11-01)

Multi-weighted Markov Decision Processes with Reachability Objectives
af: Patricia Bouyer, et al.
Udgivet: (2018-09-01)

Verification of general Markov decision processes by approximate similarity relations and policy refinement
af: Haesaert, S, et al.
Udgivet: (2017)

Faster Convergence of Modified Policy Iteration for Quantitative Verification of Markov Decision Processes
af: M.S. Mohagheghi
Udgivet: (2018-12-01)

Geometric branching reproduction Markov processes
af: Assen Tchorbadjieff, et al.
Udgivet: (2020-09-01)

Nonlinear Markov branching processes with immigration and resurrection
af: Zhang Lina, et al.
Udgivet: (2024-10-01)

Markov decision processes /
af: 352167 White, D. J.
Udgivet: (1993)

Controllable Summarization with Constrained Markov Decision Process
af: Hou Pong Chan, et al.
Udgivet: (2021-01-01)

Bounds for Markov Decision Processes
af: Desai, Vijay V., et al.
Udgivet: (2019)

Framework for solving time-delayed Markov Decision Processes
af: Yorgo Sawaya, et al.
Udgivet: (2023-07-01)

Quantum logic gate synthesis as a Markov decision process
af: M. Sohaib Alam, et al.
Udgivet: (2023-10-01)

Unifying Two Views on Multiple Mean-Payoff Objectives in Markov Decision Processes
af: Krishnendu Chatterjee, et al.
Udgivet: (2017-07-01)

The complexity of Markov decision processes
Udgivet: (2003)

Markov decision processes approximation with coupled dynamics via Markov deterministic control systems
af: Portillo-Ramírez Gustavo, et al.
Udgivet: (2023-10-01)

Symblicit algorithms for optimal strategy synthesis in monotonic Markov decision processes
af: Aaron Bohy, et al.
Udgivet: (2014-07-01)

Safety Verification of Continuous-Space Pure Jump Markov Processes
af: Esmaeil Zadeh Soudjani, S, et al.
Udgivet: (2016)

Convergence Rates and Limit Theorems for the Dual Markov Branching Process
af: Anthony G. Pakes
Udgivet: (2017-01-01)

The multiple birth properties of multi-type Markov branching processes
af: Junping Li, et al.
Udgivet: (2024-09-01)

Verification of Linear Duration Properties over Continuous Time Markov Chains
af: Chen, T, et al.
Udgivet: (2012)

Verification of Linear Duration Properties over Continuous−Time Markov Chains
af: Chen, T, et al.
Udgivet: (2012)

Monotone optimal control for a class of Markov decision processes
af: Li, Michael Z. F., et al.
Udgivet: (2013)

Polynomial time algorithms for finite horizon, stationary Markov decision processes
Udgivet: (2003)

Comparing labelled Markov decision processes
af: Kiefer, S, et al.
Udgivet: (2020)

Communicating via Markov decision processes
af: Sokota, S, et al.
Udgivet: (2022)

Entropic Regularization of Markov Decision Processes
af: Boris Belousov, et al.
Udgivet: (2019-07-01)

Markov abstractions for PAC reinforcement learning in non-Markov decision processes
af: Ronca, A, et al.
Udgivet: (2022)