A Continuous-Time Analysis of Distributed Stochastic Gradient

A Continuous-Time Analysis of Distributed Stochastic Gradient

Show other versions (1)

© 2019 Massachusetts Institute of Technology. We analyze the effect of synchronization on distributed stochastic gradient algorithms. By exploiting an analogy with dynamical models of biological quorum sensing, where synchronization between agents is induced through communication with a common signa...

Full description

Bibliographic Details
Main Authors:	Boffi, Nicholas M, Slotine, Jean-Jacques E
Format:	Article
Language:	English
Published:	MIT Press - Journals 2021
Online Access:	https://hdl.handle.net/1721.1/136586

Similar Items

A Continuous-Time Analysis of Distributed Stochastic Gradient
by: Boffi, Nicholas M, et al.
Published: (2022)

Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Prediction
by: Boffi, Nicholas M, et al.
Published: (2022)

Nonparametric Adaptive Control and Prediction: Theory and Randomized Algorithms
by: Boffi, Nicholas M., et al.
Published: (2024)

Beyond convexity—Contraction and global convergence of gradient descent
by: Wensing, Patrick M, et al.
Published: (2022)

Diffusion Maps Kalman Filter for a Class of Systems with Gradient Flows
by: Shnitzer, Tal, et al.
Published: (2021)

Contraction and Robustness of Continuous Time Primal-Dual Dynamics
by: Nguyen, Hung D., et al.
Published: (2020)

A contraction theory approach to stochastic incremental stability
by: Slotine, Jean-Jacques E., et al.
Published: (2010)

Neural Stochastic Contraction Metrics for Learning-based Control and Estimation
by: Tsukamoto, Hiroyasu, et al.
Published: (2022)

Manifold Learning With Contracting Observers for Data-Driven Time-Series Analysis
by: Shnitzer, Tal, et al.
Published: (2022)

Manifold Learning With Contracting Observers for Data-Driven Time-Series Analysis
by: Shnitzer, Tal, et al.
Published: (2021)

Audio classification from time-frequency texture
by: Slotine, Jean-Jacques E., et al.
Published: (2012)

Distributed asynchronous deterministic and stochastic gradient optimization algorithms
Published: (2002)

Convergence of asynchronous distributed gradient methods over stochastic networks
by: Xu, Jinming, et al.
Published: (2020)

A Contraction Theory-Based Analysis of the Stability of the Deterministic Extended Kalman Filter
by: Bonnabel, Silvere, et al.
Published: (2015)

Robotic manipulation of micro/nanoparticles using optical tweezers with velocity constraints and stochastic perturbations
by: Yan, Xiao, et al.
Published: (2017)

Linear Matrix Inequalities for Physically Consistent Inertial Parameter Identification: A Statistical Perspective on the Mass Distribution
by: Wensing, Patrick M., et al.
Published: (2018)

Fast Obstacle Avoidance Based on Real-Time Sensing
by: Huber, Lukas, et al.
Published: (2024)

Solving Constraint-Satisfaction Problems with Distributed Neocortical-Like Neuronal Networks
by: Rutishauser, Ueli, et al.
Published: (2019)

Continuous-Time Stochastic Games with Time-Bounded Reachability.
by: Brázdil, T, et al.
Published: (2009)

Stability Analysis Of Continuous Conjugate Gradient Method
by: Harun, Nurzalina
Published: (2008)

Content analysis of stochastic volatility model in discrete and continuous time setting
by: al-Hagyan, Mohammed, et al.
Published: (2015)

Gradient-Free Stochastic Sensitivity Analysis of the Shipboard Power System
by: Prempraneerach, P., et al.
Published: (2015)

Time-inconsistent stochastic linear-quadratic control in continuous time
by: Song, Wan Jing
Published: (2021)

Distributed Bayesian learning with stochastic natural gradient expectation propagation and the posterior server
by: Hasenclver, L, et al.
Published: (2017)

Accelerated on-line calibration of dynamic traffic assignment using distributed stochastic gradient approximation
by: Huang, Enyang, et al.
Published: (2013)

Convergence of Stochastic Proximal Gradient Algorithm
by: Rosasco, Lorenzo, et al.
Published: (2021)

Asymptotic bias of stochastic gradient search
by: Tadic, V, et al.
Published: (2011)

Carathéodory sampling for stochastic gradient descent
by: Cosentino, F, et al.
Published: (2020)

Carathéodory sampling for stochastic gradient descent
by: Cosentino, F, et al.
Published: (2020)

Asymptotic bias of stochastic gradient search
by: Doucet, A, et al.
Published: (2017)

A gradient method for optimizing stochastic systems
by: Fitzgerald, Robert John
Published: (2013)

A quorum sensing inspired algorithm for dynamic clustering
by: Slotine, Jean-Jacques E., et al.
Published: (2015)

Analysis and design of the dynamical stability of collective behavior in crowds
by: Mukovskiy, Albert, et al.
Published: (2019)

Contracting differential equations in weighted Banach spaces
by: Srinivasan, Anand, et al.
Published: (2024)

Dynamic Adaptation Gains for Nonlinear Systems With Unmatched Uncertainties
by: Lopez, Brett T., et al.
Published: (2024)

Byzantine-resilient decentralized stochastic gradient descent
by: Guo, Shangwei, et al.
Published: (2024)

Consistency and fluctuations for stochastic gradient Langevin dynamics
by: Teh, YW, et al.
Published: (2016)

Sliding on Manifolds: Geometric Attitude Control with Quaternions
by: Lopez, Brett T., et al.
Published: (2024)

Unmatched Control Barrier Functions: Certainty Equivalence Adaptive Safety
by: Lopez, Brett T., et al.
Published: (2024)

Universal Adaptive Control of Nonlinear Systems
by: Lopez, Brett T., et al.
Published: (2024)