Decentralised learning with distributed gradient descent and random features

Decentralised learning with distributed gradient descent and random features

We investigate the generalisation performance of Distributed Gradient Descent with implicit regularisation and random features in the homogenous setting where a network of agents are given data sampled independently from the same unknown distribution. Along with reducing the memory footprint, random...

Cur síos iomlán

Sonraí bibleagrafaíochta
Príomhchruthaitheoirí:	Richards, D, Rebeschini, P, Rosasco, L
Formáid:	Conference item
Teanga:	English
Foilsithe / Cruthaithe:	Proceedings of Machine Learning Research 2020

Míreanna comhchosúla

Robust gradient descent for phase retrieval
de réir: Buna-Marginean, A, et al.
Foilsithe / Cruthaithe: (2025)

Graph-dependent implicit regularisation for distributed stochastic subgradient descent
de réir: Richards, D, et al.
Foilsithe / Cruthaithe: (2020)

Generalization bounds for label noise stochastic gradient descent
de réir: Huh, JE, et al.
Foilsithe / Cruthaithe: (2023)

Generalization bounds for label noise stochastic gradient descent
de réir: Huh, JE, et al.
Foilsithe / Cruthaithe: (2024)

Optimal statistical rates for decentralised non-parametric regression with linear speed-up
de réir: Richards, D, et al.
Foilsithe / Cruthaithe: (2019)

Learning mirror maps in policy mirror descent
de réir: Alfano, C, et al.
Foilsithe / Cruthaithe: (2025)

Implicit regularization in matrix sensing via mirror descent
de réir: Wu, F, et al.
Foilsithe / Cruthaithe: (2021)

The statistical complexity of early-stopped mirror descent
de réir: Vaškevičius, T, et al.
Foilsithe / Cruthaithe: (2020)

The statistical complexity of early-stopped mirror descent
de réir: Kanade, V, et al.
Foilsithe / Cruthaithe: (2023)

Why random reshuffling beats stochastic gradient descent
de réir: Gürbüzbalaban, M., et al.
Foilsithe / Cruthaithe: (2021)

Decentralised federated learning with adaptive partial gradient aggregation
de réir: Jingyan Jiang, et al.
Foilsithe / Cruthaithe: (2020-05-01)

A continuous-time mirror descent approach to sparse phase retrieval
de réir: Wu, F, et al.
Foilsithe / Cruthaithe: (2020)

Distributed Stochastic Gradient Descent With Compressed and Skipped Communication
de réir: Tran Thi Phuong, et al.
Foilsithe / Cruthaithe: (2023-01-01)

Distributed machine learning with sparse heterogeneous data
de réir: Richards, D, et al.
Foilsithe / Cruthaithe: (2021)

Limited Gradient Descent: Learning With Noisy Labels
de réir: Yi Sun, et al.
Foilsithe / Cruthaithe: (2019-01-01)

Featured Hybrid Recommendation System Using Stochastic Gradient Descent
de réir: Si Thin Nguyen, et al.
Foilsithe / Cruthaithe: (2021-01-01)

Low-Rank Gradient Descent
de réir: Romain Cosson, et al.
Foilsithe / Cruthaithe: (2023-01-01)

On-manifold projected gradient descent
de réir: Aaron Mahler, et al.
Foilsithe / Cruthaithe: (2024-02-01)

Multi-task gradient descent for multi-task learning
de réir: Bai, Lu, et al.
Foilsithe / Cruthaithe: (2021)

Recent Advances in Stochastic Gradient Descent in Deep Learning
de réir: Yingjie Tian, et al.
Foilsithe / Cruthaithe: (2023-01-01)

Multileave gradient descent for fast online learning to rank
de réir: Whiteson, S, et al.
Foilsithe / Cruthaithe: (2016)

A novel framework for policy mirror descent with general parameterization and linear convergence
de réir: Alfano, C, et al.
Foilsithe / Cruthaithe: (2024)

Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent
de réir: Wu, F, et al.
Foilsithe / Cruthaithe: (2022)

Dual space preconditioning for gradient descent
de réir: Maddison, CJ, et al.
Foilsithe / Cruthaithe: (2021)

A Multi-View Fusion Method via Tensor Learning and Gradient Descent for Image Features
de réir: Laihang Yu, et al.
Foilsithe / Cruthaithe: (2021-01-01)

MODIFIED ARMIJO RULE ON GRADIENT DESCENT AND CONJUGATE GRADIENT
de réir: ZURAIDAH FITRIAH, et al.
Foilsithe / Cruthaithe: (2017-10-01)

Distributed stochastic gradient descent for link prediction in signed social networks
de réir: Han Zhang, et al.
Foilsithe / Cruthaithe: (2019-01-01)

Iterative Regularization via Dual Diagonal Descent
de réir: Garrigos, Guillaume, et al.
Foilsithe / Cruthaithe: (2018)

Carathéodory sampling for stochastic gradient descent
de réir: Cosentino, F, et al.
Foilsithe / Cruthaithe: (2020)

Carathéodory sampling for stochastic gradient descent
de réir: Cosentino, F, et al.
Foilsithe / Cruthaithe: (2020)

Gradient-Descent-like Ghost Imaging
de réir: Wen-Kai Yu, et al.
Foilsithe / Cruthaithe: (2021-11-01)

Semi-Stochastic Gradient Descent Methods
de réir: Jakub Konečný, et al.
Foilsithe / Cruthaithe: (2017-05-01)

Correspondence between neuroevolution and gradient descent
de réir: Stephen Whitelam, et al.
Foilsithe / Cruthaithe: (2021-11-01)

Amortized Bayesian Meta-Learning with Accelerated Gradient Descent Steps
de réir: Zhewei Zhang, et al.
Foilsithe / Cruthaithe: (2023-07-01)

Optimal convergence rate for exact policy mirror descent in discounted Markov decision processes
de réir: Johnson, E, et al.
Foilsithe / Cruthaithe: (2023)

The complexity of gradient descent: CLS = PPAD ∩ PLS
de réir: Fearnley, J, et al.
Foilsithe / Cruthaithe: (2021)

The complexity of gradient descent: CLS = PPAD∩PLS
de réir: Fearnley, J, et al.
Foilsithe / Cruthaithe: (2022)

Efficient neural codes naturally emerge through gradient descent learning
de réir: Ari S. Benjamin, et al.
Foilsithe / Cruthaithe: (2022-12-01)

Stochastic gradient descent for wind farm optimization
de réir: J. Quick, et al.
Foilsithe / Cruthaithe: (2023-08-01)

Function approximation method based on weights gradient descent in reinforcement learning
de réir: Xiaoyan QIN, et al.
Foilsithe / Cruthaithe: (2023-08-01)