Contraction and Robustness of Continuous Time Primal-Dual Dynamics

The Primal-dual (PD) algorithm is widely used in convex optimization to determine saddle points. While the stability of the PD algorithm can be easily guaranteed, strict contraction is nontrivial to establish in most cases. This letter focuses on continuous, possibly non-autonomous PD dynamics arisi...

Full description

Bibliographic Details
Main Authors: Nguyen, Hung D., Vu, Thanh Long, Turitsyn, Konstantin, Slotine, Jean-Jacques E
Other Authors: Massachusetts Institute of Technology. Department of Mechanical Engineering
Format: Article
Published: Institute of Electrical and Electronics Engineers (IEEE) 2020
Online Access:https://hdl.handle.net/1721.1/128498
Description
Summary:The Primal-dual (PD) algorithm is widely used in convex optimization to determine saddle points. While the stability of the PD algorithm can be easily guaranteed, strict contraction is nontrivial to establish in most cases. This letter focuses on continuous, possibly non-autonomous PD dynamics arising in a network context, in distributed optimization, or in systems with multiple time-scales. We show that the PD algorithm is indeed strictly contracting in specific metrics and analyze its robustness establishing stability and performance guarantees for different approximate PD systems. We derive estimates for the performance of multiple time-scale multi-layer optimization systems, and illustrate our results on a PD representation of the Automatic Generation Control of power systems.