Stochastic linear-quadratic control with conic control constraints on an infinite time horizon
This paper is concerned with a stochastic linear-quadratic (LQ) control problem in the infinite time horizon where the control is constrained in a given, arbitrary closed cone, the cost weighting matrices are allowed to be indefinite, and the state is scalar-valued. First, the (mean-square, conic) s...
| Main Authors: | , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
2005
|
| _version_ | 1797105249428701184 |
|---|---|
| author | Chen, X Zhou, X |
| author_facet | Chen, X Zhou, X |
| author_sort | Chen, X |
| collection | OXFORD |
| description | This paper is concerned with a stochastic linear-quadratic (LQ) control problem in the infinite time horizon where the control is constrained in a given, arbitrary closed cone, the cost weighting matrices are allowed to be indefinite, and the state is scalar-valued. First, the (mean-square, conic) stabilizability of the system is defined, which is then characterized by a set of simple conditions involving linear matrix inequalities (LMIs). Next, the issue of well-posedness of the underlying optimal LQ control, which is necessitated by the indefiniteness of the problem, is addressed in great detail, and necessary and sufficient conditions of the well-posedness are presented. On the other hand, to address the LQ optimality two new algebraic equations à la Riccati, called extended algebraic Riccati equations (EAREs), along with the notion of their stabilizing solutions, are introduced for the first time. Optimal feedback control as well as the optimal value are explicitly derived in terms of the stabilizing solutions to the EAREs. Moreover, several cases when the stabilizing solutions do exist are discussed and algorithms of computing the solutions are presented. Finally, numerical examples are provided to illustrate the theoretical results established. © 2004 Society for Industrial and Applied Mathematics. |
| first_indexed | 2024-03-07T06:44:48Z |
| format | Journal article |
| id | oxford-uuid:fa811b20-070f-4b6b-9df9-ac8076e787dd |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T06:44:48Z |
| publishDate | 2005 |
| record_format | dspace |
| spelling | oxford-uuid:fa811b20-070f-4b6b-9df9-ac8076e787dd2022-03-27T13:06:25ZStochastic linear-quadratic control with conic control constraints on an infinite time horizonJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:fa811b20-070f-4b6b-9df9-ac8076e787ddEnglishSymplectic Elements at Oxford2005Chen, XZhou, XThis paper is concerned with a stochastic linear-quadratic (LQ) control problem in the infinite time horizon where the control is constrained in a given, arbitrary closed cone, the cost weighting matrices are allowed to be indefinite, and the state is scalar-valued. First, the (mean-square, conic) stabilizability of the system is defined, which is then characterized by a set of simple conditions involving linear matrix inequalities (LMIs). Next, the issue of well-posedness of the underlying optimal LQ control, which is necessitated by the indefiniteness of the problem, is addressed in great detail, and necessary and sufficient conditions of the well-posedness are presented. On the other hand, to address the LQ optimality two new algebraic equations à la Riccati, called extended algebraic Riccati equations (EAREs), along with the notion of their stabilizing solutions, are introduced for the first time. Optimal feedback control as well as the optimal value are explicitly derived in terms of the stabilizing solutions to the EAREs. Moreover, several cases when the stabilizing solutions do exist are discussed and algorithms of computing the solutions are presented. Finally, numerical examples are provided to illustrate the theoretical results established. © 2004 Society for Industrial and Applied Mathematics. |
| spellingShingle | Chen, X Zhou, X Stochastic linear-quadratic control with conic control constraints on an infinite time horizon |
| title | Stochastic linear-quadratic control with conic control constraints on an infinite time horizon |
| title_full | Stochastic linear-quadratic control with conic control constraints on an infinite time horizon |
| title_fullStr | Stochastic linear-quadratic control with conic control constraints on an infinite time horizon |
| title_full_unstemmed | Stochastic linear-quadratic control with conic control constraints on an infinite time horizon |
| title_short | Stochastic linear-quadratic control with conic control constraints on an infinite time horizon |
| title_sort | stochastic linear quadratic control with conic control constraints on an infinite time horizon |
| work_keys_str_mv | AT chenx stochasticlinearquadraticcontrolwithconiccontrolconstraintsonaninfinitetimehorizon AT zhoux stochasticlinearquadraticcontrolwithconiccontrolconstraintsonaninfinitetimehorizon |