Equilibria-based probabilistic model checking for concurrent stochastic games

Probabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus on zero-sum goals and cannot reason about scenarios where ent...

Szczegółowa specyfikacja

Opis bibliograficzny
Główni autorzy: Kwiatkowska, M, Norman, G, Parker, D, Santos, G
Format: Conference item
Wydane: Springer Verlag 2019
_version_ 1826285897377644544
author Kwiatkowska, M
Norman, G
Parker, D
Santos, G
author_facet Kwiatkowska, M
Norman, G
Parker, D
Santos, G
author_sort Kwiatkowska, M
collection OXFORD
description Probabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus on zero-sum goals and cannot reason about scenarios where entities are endowed with different objectives. In this paper, we propose probabilistic model checking techniques for concurrent stochastic games based on Nash equilibria. We extend the temporal logic rPATL (probabilistic alternating-time temporal logic with rewards) to allow reasoning about players with distinct quantitative goals, which capture either the probability of an event occurring or a reward measure. We present algorithms to synthesise strategies that are subgame perfect social welfare optimal Nash equilibria, i.e., where there is no incentive for any players to unilaterally change their strategy in any state of the game, whilst the combined probabilities or rewards are maximised. We implement our techniques in the PRISM-games tool and apply them to several case studies, including network protocols and robot navigation, showing the benefits compared to existing approaches.
first_indexed 2024-03-07T01:35:43Z
format Conference item
id oxford-uuid:951e3b51-d4e5-40fd-ad20-a8bb3c1357dd
institution University of Oxford
last_indexed 2024-03-07T01:35:43Z
publishDate 2019
publisher Springer Verlag
record_format dspace
spelling oxford-uuid:951e3b51-d4e5-40fd-ad20-a8bb3c1357dd2022-03-26T23:43:58ZEquilibria-based probabilistic model checking for concurrent stochastic gamesConference itemhttp://purl.org/coar/resource_type/c_5794uuid:951e3b51-d4e5-40fd-ad20-a8bb3c1357ddSymplectic Elements at OxfordSpringer Verlag2019Kwiatkowska, MNorman, GParker, DSantos, GProbabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus on zero-sum goals and cannot reason about scenarios where entities are endowed with different objectives. In this paper, we propose probabilistic model checking techniques for concurrent stochastic games based on Nash equilibria. We extend the temporal logic rPATL (probabilistic alternating-time temporal logic with rewards) to allow reasoning about players with distinct quantitative goals, which capture either the probability of an event occurring or a reward measure. We present algorithms to synthesise strategies that are subgame perfect social welfare optimal Nash equilibria, i.e., where there is no incentive for any players to unilaterally change their strategy in any state of the game, whilst the combined probabilities or rewards are maximised. We implement our techniques in the PRISM-games tool and apply them to several case studies, including network protocols and robot navigation, showing the benefits compared to existing approaches.
spellingShingle Kwiatkowska, M
Norman, G
Parker, D
Santos, G
Equilibria-based probabilistic model checking for concurrent stochastic games
title Equilibria-based probabilistic model checking for concurrent stochastic games
title_full Equilibria-based probabilistic model checking for concurrent stochastic games
title_fullStr Equilibria-based probabilistic model checking for concurrent stochastic games
title_full_unstemmed Equilibria-based probabilistic model checking for concurrent stochastic games
title_short Equilibria-based probabilistic model checking for concurrent stochastic games
title_sort equilibria based probabilistic model checking for concurrent stochastic games
work_keys_str_mv AT kwiatkowskam equilibriabasedprobabilisticmodelcheckingforconcurrentstochasticgames
AT normang equilibriabasedprobabilisticmodelcheckingforconcurrentstochasticgames
AT parkerd equilibriabasedprobabilisticmodelcheckingforconcurrentstochasticgames
AT santosg equilibriabasedprobabilisticmodelcheckingforconcurrentstochasticgames