Decentralised learning with distributed gradient descent and random features

Decentralised learning with distributed gradient descent and random features

We investigate the generalisation performance of Distributed Gradient Descent with implicit regularisation and random features in the homogenous setting where a network of agents are given data sampled independently from the same unknown distribution. Along with reducing the memory footprint, random...

Descrizione completa

Dettagli Bibliografici
Autori principali:	Richards, D, Rebeschini, P, Rosasco, L
Natura:	Conference item
Lingua:	English
Pubblicazione:	Proceedings of Machine Learning Research 2020

Documenti analoghi

Robust gradient descent for phase retrieval
di: Buna-Marginean, A, et al.
Pubblicazione: (2025)

Graph-dependent implicit regularisation for distributed stochastic subgradient descent
di: Richards, D, et al.
Pubblicazione: (2020)

Generalization bounds for label noise stochastic gradient descent
di: Huh, JE, et al.
Pubblicazione: (2023)

Generalization bounds for label noise stochastic gradient descent
di: Huh, JE, et al.
Pubblicazione: (2024)

Optimal statistical rates for decentralised non-parametric regression with linear speed-up
di: Richards, D, et al.
Pubblicazione: (2019)

Learning mirror maps in policy mirror descent
di: Alfano, C, et al.
Pubblicazione: (2025)

Implicit regularization in matrix sensing via mirror descent
di: Wu, F, et al.
Pubblicazione: (2021)

The statistical complexity of early-stopped mirror descent
di: Vaškevičius, T, et al.
Pubblicazione: (2020)

The statistical complexity of early-stopped mirror descent
di: Kanade, V, et al.
Pubblicazione: (2023)

Why random reshuffling beats stochastic gradient descent
di: Gürbüzbalaban, M., et al.
Pubblicazione: (2021)

A continuous-time mirror descent approach to sparse phase retrieval
di: Wu, F, et al.
Pubblicazione: (2020)

Decentralised federated learning with adaptive partial gradient aggregation
di: Jingyan Jiang, et al.
Pubblicazione: (2020-05-01)

Distributed machine learning with sparse heterogeneous data
di: Richards, D, et al.
Pubblicazione: (2021)

Distributed Stochastic Gradient Descent With Compressed and Skipped Communication
di: Tran Thi Phuong, et al.
Pubblicazione: (2023-01-01)

Limited Gradient Descent: Learning With Noisy Labels
di: Yi Sun, et al.
Pubblicazione: (2019-01-01)

Featured Hybrid Recommendation System Using Stochastic Gradient Descent
di: Si Thin Nguyen, et al.
Pubblicazione: (2021-01-01)

Low-Rank Gradient Descent
di: Romain Cosson, et al.
Pubblicazione: (2023-01-01)

On-manifold projected gradient descent
di: Aaron Mahler, et al.
Pubblicazione: (2024-02-01)

Multi-task gradient descent for multi-task learning
di: Bai, Lu, et al.
Pubblicazione: (2021)

Recent Advances in Stochastic Gradient Descent in Deep Learning
di: Yingjie Tian, et al.
Pubblicazione: (2023-01-01)

Multileave gradient descent for fast online learning to rank
di: Whiteson, S, et al.
Pubblicazione: (2016)

A novel framework for policy mirror descent with general parameterization and linear convergence
di: Alfano, C, et al.
Pubblicazione: (2024)

Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent
di: Wu, F, et al.
Pubblicazione: (2022)

Dual space preconditioning for gradient descent
di: Maddison, CJ, et al.
Pubblicazione: (2021)

A Multi-View Fusion Method via Tensor Learning and Gradient Descent for Image Features
di: Laihang Yu, et al.
Pubblicazione: (2021-01-01)

MODIFIED ARMIJO RULE ON GRADIENT DESCENT AND CONJUGATE GRADIENT
di: ZURAIDAH FITRIAH, et al.
Pubblicazione: (2017-10-01)

Distributed stochastic gradient descent for link prediction in signed social networks
di: Han Zhang, et al.
Pubblicazione: (2019-01-01)

Iterative Regularization via Dual Diagonal Descent
di: Garrigos, Guillaume, et al.
Pubblicazione: (2018)

Carathéodory sampling for stochastic gradient descent
di: Cosentino, F, et al.
Pubblicazione: (2020)

Carathéodory sampling for stochastic gradient descent
di: Cosentino, F, et al.
Pubblicazione: (2020)

Amortized Bayesian Meta-Learning with Accelerated Gradient Descent Steps
di: Zhewei Zhang, et al.
Pubblicazione: (2023-07-01)

Gradient-Descent-like Ghost Imaging
di: Wen-Kai Yu, et al.
Pubblicazione: (2021-11-01)

Semi-Stochastic Gradient Descent Methods
di: Jakub Konečný, et al.
Pubblicazione: (2017-05-01)

Correspondence between neuroevolution and gradient descent
di: Stephen Whitelam, et al.
Pubblicazione: (2021-11-01)

Optimal convergence rate for exact policy mirror descent in discounted Markov decision processes
di: Johnson, E, et al.
Pubblicazione: (2023)

The complexity of gradient descent: CLS = PPAD ∩ PLS
di: Fearnley, J, et al.
Pubblicazione: (2021)

The complexity of gradient descent: CLS = PPAD∩PLS
di: Fearnley, J, et al.
Pubblicazione: (2022)

Efficient neural codes naturally emerge through gradient descent learning
di: Ari S. Benjamin, et al.
Pubblicazione: (2022-12-01)

Stochastic gradient descent for wind farm optimization
di: J. Quick, et al.
Pubblicazione: (2023-08-01)

Function approximation method based on weights gradient descent in reinforcement learning
di: Xiaoyan QIN, et al.
Pubblicazione: (2023-08-01)