Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games
We consider the problem of computing the set of initial states of a dynamical system such that there exists a control strategy to ensure that the trajectories satisfy a temporal logic specification with probability 1 (almost-surely). We focus on discrete-time, stochastic linear dynamics and specific...
| Main Authors: | , , , , , |
|---|---|
| Format: | Journal article |
| Published: |
Elsevier
2016
|
| _version_ | 1826303575234445312 |
|---|---|
| author | Svorenova, M Kretinsky, J Chmelik, M Chatterjee, K Cerna, I Belta, C |
| author_facet | Svorenova, M Kretinsky, J Chmelik, M Chatterjee, K Cerna, I Belta, C |
| author_sort | Svorenova, M |
| collection | OXFORD |
| description | We consider the problem of computing the set of initial states of a dynamical system such that there exists a control strategy to ensure that the trajectories satisfy a temporal logic specification with probability 1 (almost-surely). We focus on discrete-time, stochastic linear dynamics and specifications given as formulas of the Generalized Reactivity(1) fragment of Linear Temporal Logic over linear predicates in the states of the system. We propose a solution based on iterative abstraction-refinement, and turn-based 2-player probabilistic games. While the theoretical guarantee of our algorithm after any finite number of iterations is only a partial solution, we show that if our algorithm terminates, then the result is the set of all satisfying initial states. Moreover, for any (partial) solution our algorithm synthesizes witness control strategies to ensure almost-sure satisfaction of the temporal logic specification. While the proposed algorithm guarantees progress and soundness in every iteration, it is computationally demanding. We offer an alternative, more efficient solution for the reachability properties that decomposes the problem into a series of smaller problems of the same type. All algorithms are demonstrated on an illustrative case study. |
| first_indexed | 2024-03-07T06:04:47Z |
| format | Journal article |
| id | oxford-uuid:ed75f5f3-273a-488f-80cb-d7efd86732ed |
| institution | University of Oxford |
| last_indexed | 2024-03-07T06:04:47Z |
| publishDate | 2016 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:ed75f5f3-273a-488f-80cb-d7efd86732ed2022-03-27T11:25:13ZTemporal logic control for stochastic linear systems using abstraction refinement of probabilistic gamesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:ed75f5f3-273a-488f-80cb-d7efd86732edSymplectic Elements at OxfordElsevier2016Svorenova, MKretinsky, JChmelik, MChatterjee, KCerna, IBelta, CWe consider the problem of computing the set of initial states of a dynamical system such that there exists a control strategy to ensure that the trajectories satisfy a temporal logic specification with probability 1 (almost-surely). We focus on discrete-time, stochastic linear dynamics and specifications given as formulas of the Generalized Reactivity(1) fragment of Linear Temporal Logic over linear predicates in the states of the system. We propose a solution based on iterative abstraction-refinement, and turn-based 2-player probabilistic games. While the theoretical guarantee of our algorithm after any finite number of iterations is only a partial solution, we show that if our algorithm terminates, then the result is the set of all satisfying initial states. Moreover, for any (partial) solution our algorithm synthesizes witness control strategies to ensure almost-sure satisfaction of the temporal logic specification. While the proposed algorithm guarantees progress and soundness in every iteration, it is computationally demanding. We offer an alternative, more efficient solution for the reachability properties that decomposes the problem into a series of smaller problems of the same type. All algorithms are demonstrated on an illustrative case study. |
| spellingShingle | Svorenova, M Kretinsky, J Chmelik, M Chatterjee, K Cerna, I Belta, C Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| title | Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| title_full | Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| title_fullStr | Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| title_full_unstemmed | Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| title_short | Temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| title_sort | temporal logic control for stochastic linear systems using abstraction refinement of probabilistic games |
| work_keys_str_mv | AT svorenovam temporallogiccontrolforstochasticlinearsystemsusingabstractionrefinementofprobabilisticgames AT kretinskyj temporallogiccontrolforstochasticlinearsystemsusingabstractionrefinementofprobabilisticgames AT chmelikm temporallogiccontrolforstochasticlinearsystemsusingabstractionrefinementofprobabilisticgames AT chatterjeek temporallogiccontrolforstochasticlinearsystemsusingabstractionrefinementofprobabilisticgames AT cernai temporallogiccontrolforstochasticlinearsystemsusingabstractionrefinementofprobabilisticgames AT beltac temporallogiccontrolforstochasticlinearsystemsusingabstractionrefinementofprobabilisticgames |