Optimization on matrix manifold based on gradient information and its applications in network control
Vector function optimization problems, in which one or more variables are multidimensional vectors or infinite-dimensional vectors, have been extensively studied and demonstrated in existing schemes. In various real life applications, a cost function to be optimized usually involves matrix variables...
| Main Authors: | , , , , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/141203 |
| _version_ | 1826120571221442560 |
|---|---|
| author | Li, Guoqi Tang, Pei Meng, Ziyang Wen, Changyun Pei, Jing Shi, Luping |
| author2 | School of Electrical and Electronic Engineering |
| author_facet | School of Electrical and Electronic Engineering Li, Guoqi Tang, Pei Meng, Ziyang Wen, Changyun Pei, Jing Shi, Luping |
| author_sort | Li, Guoqi |
| collection | NTU |
| description | Vector function optimization problems, in which one or more variables are multidimensional vectors or infinite-dimensional vectors, have been extensively studied and demonstrated in existing schemes. In various real life applications, a cost function to be optimized usually involves matrix variables subjected to certain constraints. Locating its minimum can be modeled as an optimization problem on matrix manifold which is investigated in this paper. We first present an index-notation-arrangement based chain rule (I-Chain rule) to obtain the gradient information of the cost function. Two iterative algorithms, namely, trace-constraint-based projected gradient method (TPGM) and orthonormal-constraint-based projected gradient method (OPGM) are proposed and their convergence properties are established. We find that the network control problems can be effectively solved by both TPGM and OPGM. Two important phenomena are observed. For controlling directed networks with selectable inputs, both TPGM and OPGM tend to locate the nodes that divides the elementary stem/circle/dilation equally for consuming less energy, with OPGM having a slightly higher chance than TPGM. For controlling directed networks by only evolving the connection strengths on a fixed network structure, we find that after a network adaptively changes its topology in such a way that many similar sub-networks are gradually evolved, the control cost attains its minimum. Our work takes a further step from understanding optimization problems on matrix manifold to extending their applications in science and engineering. |
| first_indexed | 2024-10-01T05:18:38Z |
| format | Journal Article |
| id | ntu-10356/141203 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:18:38Z |
| publishDate | 2020 |
| record_format | dspace |
| spelling | ntu-10356/1412032020-06-05T01:54:31Z Optimization on matrix manifold based on gradient information and its applications in network control Li, Guoqi Tang, Pei Meng, Ziyang Wen, Changyun Pei, Jing Shi, Luping School of Electrical and Electronic Engineering Engineering::Electrical and electronic engineering Matrix Function Optimization Matrix Variable Vector function optimization problems, in which one or more variables are multidimensional vectors or infinite-dimensional vectors, have been extensively studied and demonstrated in existing schemes. In various real life applications, a cost function to be optimized usually involves matrix variables subjected to certain constraints. Locating its minimum can be modeled as an optimization problem on matrix manifold which is investigated in this paper. We first present an index-notation-arrangement based chain rule (I-Chain rule) to obtain the gradient information of the cost function. Two iterative algorithms, namely, trace-constraint-based projected gradient method (TPGM) and orthonormal-constraint-based projected gradient method (OPGM) are proposed and their convergence properties are established. We find that the network control problems can be effectively solved by both TPGM and OPGM. Two important phenomena are observed. For controlling directed networks with selectable inputs, both TPGM and OPGM tend to locate the nodes that divides the elementary stem/circle/dilation equally for consuming less energy, with OPGM having a slightly higher chance than TPGM. For controlling directed networks by only evolving the connection strengths on a fixed network structure, we find that after a network adaptively changes its topology in such a way that many similar sub-networks are gradually evolved, the control cost attains its minimum. Our work takes a further step from understanding optimization problems on matrix manifold to extending their applications in science and engineering. 2020-06-05T01:54:30Z 2020-06-05T01:54:30Z 2018 Journal Article Li, G., Tang, P., Meng, Z., Wen, C., Pei, J., & Shi, L. (2018). Optimization on matrix manifold based on gradient information and its applications in network control. Physica A, 508, 481-500. doi:10.1016/j.physa.2018.05.117 0378-4371 https://hdl.handle.net/10356/141203 10.1016/j.physa.2018.05.117 2-s2.0-85047838271 508 481 500 en Physica A:Statistical Mechanics and its Applications © 2018 Published by Elsevier B.V. All rights reserved. |
| spellingShingle | Engineering::Electrical and electronic engineering Matrix Function Optimization Matrix Variable Li, Guoqi Tang, Pei Meng, Ziyang Wen, Changyun Pei, Jing Shi, Luping Optimization on matrix manifold based on gradient information and its applications in network control |
| title | Optimization on matrix manifold based on gradient information and its applications in network control |
| title_full | Optimization on matrix manifold based on gradient information and its applications in network control |
| title_fullStr | Optimization on matrix manifold based on gradient information and its applications in network control |
| title_full_unstemmed | Optimization on matrix manifold based on gradient information and its applications in network control |
| title_short | Optimization on matrix manifold based on gradient information and its applications in network control |
| title_sort | optimization on matrix manifold based on gradient information and its applications in network control |
| topic | Engineering::Electrical and electronic engineering Matrix Function Optimization Matrix Variable |
| url | https://hdl.handle.net/10356/141203 |
| work_keys_str_mv | AT liguoqi optimizationonmatrixmanifoldbasedongradientinformationanditsapplicationsinnetworkcontrol AT tangpei optimizationonmatrixmanifoldbasedongradientinformationanditsapplicationsinnetworkcontrol AT mengziyang optimizationonmatrixmanifoldbasedongradientinformationanditsapplicationsinnetworkcontrol AT wenchangyun optimizationonmatrixmanifoldbasedongradientinformationanditsapplicationsinnetworkcontrol AT peijing optimizationonmatrixmanifoldbasedongradientinformationanditsapplicationsinnetworkcontrol AT shiluping optimizationonmatrixmanifoldbasedongradientinformationanditsapplicationsinnetworkcontrol |