Of Cores: A Partial-Exploration Framework for Markov Decision Processes

We introduce a framework for approximate analysis of Markov decision processes (MDP) with bounded-, unbounded-, and infinite-horizon properties. The main idea is to identify a "core" of an MDP, i.e., a subsystem where we provably remain with high probability, and to avoid computation on th...

Full description

Bibliographic Details
Main Authors: Jan Křetínský, Tobias Meggendorfer
Format: Article
Language:English
Published: Logical Methods in Computer Science e.V. 2020-10-01
Series:Logical Methods in Computer Science
Subjects:
Online Access:https://lmcs.episciences.org/5978/pdf