Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks
In this paper, we investigate distributed online optimization over multi-agent networks, where a group of agents aim to cooperatively seek the minimum value of a time-varying global loss function that can be expressed as the sum of the local loss functions privately owned by a single agent on the ne...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10374368/ |
| _version_ | 1827390716485042176 |
|---|---|
| author | Jiayi Wu Yu-Ping Tian |
| author_facet | Jiayi Wu Yu-Ping Tian |
| author_sort | Jiayi Wu |
| collection | DOAJ |
| description | In this paper, we investigate distributed online optimization over multi-agent networks, where a group of agents aim to cooperatively seek the minimum value of a time-varying global loss function that can be expressed as the sum of the local loss functions privately owned by a single agent on the network at each iteration. In addition, all agents do not know the future loss function, and information about the loss function is disclosed only after the agent has made a decision. We are interested in scenarios where the communication topology of a multi-agent network is a sequence of time-varying unbalanced graphs and the loss function of each agent is a class of non-strongly convex functions. We generalize the distributed online Newton step algorithm to a more general multi-agent network by introducing a consensual-based auxiliary estimation to rescale the contribution of each agent in optimization. Our algorithm only uses row stochastic matrices and does not require the agent to know the out-degree of its in-neighbors. The convergence of regret bound over time-varying unbalanced networks is rigorously proved. Simulation results also verify the effectiveness of the proposed algorithm, and show its advantage in convergence speed compared with the first-order algorithms. |
| first_indexed | 2024-03-08T16:56:47Z |
| format | Article |
| id | doaj.art-55f29a4ee6f849c6b58574269ed06676 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T16:56:47Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-55f29a4ee6f849c6b58574269ed066762024-01-05T00:03:19ZengIEEEIEEE Access2169-35362024-01-01121189120010.1109/ACCESS.2023.334764910374368Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced NetworksJiayi Wu0https://orcid.org/0009-0000-7616-857XYu-Ping Tian1https://orcid.org/0000-0003-1193-3394School of Automation, Hangzhou Dianzi University, Hangzhou, ChinaSchool of Automation, Hangzhou Dianzi University, Hangzhou, ChinaIn this paper, we investigate distributed online optimization over multi-agent networks, where a group of agents aim to cooperatively seek the minimum value of a time-varying global loss function that can be expressed as the sum of the local loss functions privately owned by a single agent on the network at each iteration. In addition, all agents do not know the future loss function, and information about the loss function is disclosed only after the agent has made a decision. We are interested in scenarios where the communication topology of a multi-agent network is a sequence of time-varying unbalanced graphs and the loss function of each agent is a class of non-strongly convex functions. We generalize the distributed online Newton step algorithm to a more general multi-agent network by introducing a consensual-based auxiliary estimation to rescale the contribution of each agent in optimization. Our algorithm only uses row stochastic matrices and does not require the agent to know the out-degree of its in-neighbors. The convergence of regret bound over time-varying unbalanced networks is rigorously proved. Simulation results also verify the effectiveness of the proposed algorithm, and show its advantage in convergence speed compared with the first-order algorithms.https://ieeexplore.ieee.org/document/10374368/Distributed optimizationonline convex optimizationNewton step projection algorithmmulti-agent networktime-varying unbalanced directed graphs |
| spellingShingle | Jiayi Wu Yu-Ping Tian Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks IEEE Access Distributed optimization online convex optimization Newton step projection algorithm multi-agent network time-varying unbalanced directed graphs |
| title | Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks |
| title_full | Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks |
| title_fullStr | Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks |
| title_full_unstemmed | Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks |
| title_short | Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks |
| title_sort | distributed newton step projection algorithm for online convex optimization over time varying unbalanced networks |
| topic | Distributed optimization online convex optimization Newton step projection algorithm multi-agent network time-varying unbalanced directed graphs |
| url | https://ieeexplore.ieee.org/document/10374368/ |
| work_keys_str_mv | AT jiayiwu distributednewtonstepprojectionalgorithmforonlineconvexoptimizationovertimevaryingunbalancednetworks AT yupingtian distributednewtonstepprojectionalgorithmforonlineconvexoptimizationovertimevaryingunbalancednetworks |