Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives.

Controller Synthesis and Verification for Markov Decision Processes with Qualitative Branching Time Objectives.

We show that the controller synthesis and verification problems for Markov decision processes with qualitative PECTL* objectives are 2-EXPTIME complete. More precisely, the algorithms are polynomial in the size of a given Markov decision process and doubly exponential in the size of a given qualitat...

Бүрэн тодорхойлолт

Номзүйн дэлгэрэнгүй
Үндсэн зохиолчид:	Brázdil, T, Forejt, V, Kucera, A
Бусад зохиолчид:	Aceto, L
Формат:	Journal article
Хэл сонгох:	English
Хэвлэсэн:	Springer 2008

Ижил төстэй зүйлс

Markov Decision Processes with Multiple Long-run Average Objectives
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2011)

Reachability in recursive Markov decision processes.
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2008)

Markov Decision Processes with Multiple Long-run Average Objectives
-н: Tomáš Brázdil, зэрэг
Хэвлэсэн: (2014-02-01)

Trading Performance for Stability in Markov Decision Processes
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2013)

Trading performance for stability in Markov decision processes
-н: Brazdil, T, зэрэг
Хэвлэсэн: (2016)

Branching-Time Model-Checking of Probabilistic Pushdown Automata.
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2009)

Continuous-Time Stochastic Games with Time-Bounded Reachability.
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2009)

Multi-objective robust strategy synthesis for Interval Markov decision processes
-н: Hahn, E, зэрэг
Хэвлэсэн: (2017)

Life is Random, Time is Not: Markov Decision Processes with Window Objectives
-н: Thomas Brihaye, зэрэг
Хэвлэсэн: (2020-12-01)

Synchronizing Objectives for Markov Decision Processes
-н: Mahsa Shirmohammadi, зэрэг
Хэвлэсэн: (2011-02-01)

The Satisfiability Problem for Probabilistic CTL.
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2008)

Stability in graphs and games
-н: Brázdil, T, зэрэг
Хэвлэсэн: (2016)

Quantitative Multi-objective Verification for Probabilistic Systems.
-н: Forejt, V, зэрэг
Хэвлэсэн: (2011)

MULTI-OBJECTIVE MODEL CHECKING OF MARKOV DECISION PROCESSES
-н: Etessami, K, зэрэг
Хэвлэсэн: (2008)

Multi-Objective Model Checking of Markov Decision Processes
-н: Kousha Etessami, зэрэг
Хэвлэсэн: (2008-11-01)

Multi-weighted Markov Decision Processes with Reachability Objectives
-н: Patricia Bouyer, зэрэг
Хэвлэсэн: (2018-09-01)

Verification of general Markov decision processes by approximate similarity relations and policy refinement
-н: Haesaert, S, зэрэг
Хэвлэсэн: (2017)

Faster Convergence of Modified Policy Iteration for Quantitative Verification of Markov Decision Processes
-н: M.S. Mohagheghi
Хэвлэсэн: (2018-12-01)

Geometric branching reproduction Markov processes
-н: Assen Tchorbadjieff, зэрэг
Хэвлэсэн: (2020-09-01)

Nonlinear Markov branching processes with immigration and resurrection
-н: Zhang Lina, зэрэг
Хэвлэсэн: (2024-10-01)

Markov decision processes /
-н: 352167 White, D. J.
Хэвлэсэн: (1993)

Controllable Summarization with Constrained Markov Decision Process
-н: Hou Pong Chan, зэрэг
Хэвлэсэн: (2021-01-01)

Bounds for Markov Decision Processes
-н: Desai, Vijay V., зэрэг
Хэвлэсэн: (2019)

Framework for solving time-delayed Markov Decision Processes
-н: Yorgo Sawaya, зэрэг
Хэвлэсэн: (2023-07-01)

Quantum logic gate synthesis as a Markov decision process
-н: M. Sohaib Alam, зэрэг
Хэвлэсэн: (2023-10-01)

Unifying Two Views on Multiple Mean-Payoff Objectives in Markov Decision Processes
-н: Krishnendu Chatterjee, зэрэг
Хэвлэсэн: (2017-07-01)

The complexity of Markov decision processes
Хэвлэсэн: (2003)

Markov decision processes approximation with coupled dynamics via Markov deterministic control systems
-н: Portillo-Ramírez Gustavo, зэрэг
Хэвлэсэн: (2023-10-01)

Symblicit algorithms for optimal strategy synthesis in monotonic Markov decision processes
-н: Aaron Bohy, зэрэг
Хэвлэсэн: (2014-07-01)

Safety Verification of Continuous-Space Pure Jump Markov Processes
-н: Esmaeil Zadeh Soudjani, S, зэрэг
Хэвлэсэн: (2016)

Convergence Rates and Limit Theorems for the Dual Markov Branching Process
-н: Anthony G. Pakes
Хэвлэсэн: (2017-01-01)

The multiple birth properties of multi-type Markov branching processes
-н: Junping Li, зэрэг
Хэвлэсэн: (2024-09-01)

Verification of Linear Duration Properties over Continuous Time Markov Chains
-н: Chen, T, зэрэг
Хэвлэсэн: (2012)

Verification of Linear Duration Properties over Continuous−Time Markov Chains
-н: Chen, T, зэрэг
Хэвлэсэн: (2012)

Monotone optimal control for a class of Markov decision processes
-н: Li, Michael Z. F., зэрэг
Хэвлэсэн: (2013)

Polynomial time algorithms for finite horizon, stationary Markov decision processes
Хэвлэсэн: (2003)

Comparing labelled Markov decision processes
-н: Kiefer, S, зэрэг
Хэвлэсэн: (2020)

Communicating via Markov decision processes
-н: Sokota, S, зэрэг
Хэвлэсэн: (2022)

Entropic Regularization of Markov Decision Processes
-н: Boris Belousov, зэрэг
Хэвлэсэн: (2019-07-01)

Markov abstractions for PAC reinforcement learning in non-Markov decision processes
-н: Ronca, A, зэрэг
Хэвлэсэн: (2022)