Decentralised learning with distributed gradient descent and random features

Decentralised learning with distributed gradient descent and random features

We investigate the generalisation performance of Distributed Gradient Descent with implicit regularisation and random features in the homogenous setting where a network of agents are given data sampled independently from the same unknown distribution. Along with reducing the memory footprint, random...

Disgrifiad llawn

Manylion Llyfryddiaeth
Prif Awduron:	Richards, D, Rebeschini, P, Rosasco, L
Fformat:	Conference item
Iaith:	English
Cyhoeddwyd:	Proceedings of Machine Learning Research 2020

Eitemau Tebyg

Robust gradient descent for phase retrieval
gan: Buna-Marginean, A, et al.
Cyhoeddwyd: (2025)

Graph-dependent implicit regularisation for distributed stochastic subgradient descent
gan: Richards, D, et al.
Cyhoeddwyd: (2020)

Generalization bounds for label noise stochastic gradient descent
gan: Huh, JE, et al.
Cyhoeddwyd: (2023)

Generalization bounds for label noise stochastic gradient descent
gan: Huh, JE, et al.
Cyhoeddwyd: (2024)

Optimal statistical rates for decentralised non-parametric regression with linear speed-up
gan: Richards, D, et al.
Cyhoeddwyd: (2019)

Learning mirror maps in policy mirror descent
gan: Alfano, C, et al.
Cyhoeddwyd: (2025)

Implicit regularization in matrix sensing via mirror descent
gan: Wu, F, et al.
Cyhoeddwyd: (2021)

The statistical complexity of early-stopped mirror descent
gan: Vaškevičius, T, et al.
Cyhoeddwyd: (2020)

The statistical complexity of early-stopped mirror descent
gan: Kanade, V, et al.
Cyhoeddwyd: (2023)

Why random reshuffling beats stochastic gradient descent
gan: Gürbüzbalaban, M., et al.
Cyhoeddwyd: (2021)

A continuous-time mirror descent approach to sparse phase retrieval
gan: Wu, F, et al.
Cyhoeddwyd: (2020)

Decentralised federated learning with adaptive partial gradient aggregation
gan: Jingyan Jiang, et al.
Cyhoeddwyd: (2020-05-01)

Distributed machine learning with sparse heterogeneous data
gan: Richards, D, et al.
Cyhoeddwyd: (2021)

Distributed Stochastic Gradient Descent With Compressed and Skipped Communication
gan: Tran Thi Phuong, et al.
Cyhoeddwyd: (2023-01-01)

Limited Gradient Descent: Learning With Noisy Labels
gan: Yi Sun, et al.
Cyhoeddwyd: (2019-01-01)

Featured Hybrid Recommendation System Using Stochastic Gradient Descent
gan: Si Thin Nguyen, et al.
Cyhoeddwyd: (2021-01-01)

Low-Rank Gradient Descent
gan: Romain Cosson, et al.
Cyhoeddwyd: (2023-01-01)

On-manifold projected gradient descent
gan: Aaron Mahler, et al.
Cyhoeddwyd: (2024-02-01)

Multi-task gradient descent for multi-task learning
gan: Bai, Lu, et al.
Cyhoeddwyd: (2021)

Recent Advances in Stochastic Gradient Descent in Deep Learning
gan: Yingjie Tian, et al.
Cyhoeddwyd: (2023-01-01)

Multileave gradient descent for fast online learning to rank
gan: Whiteson, S, et al.
Cyhoeddwyd: (2016)

A novel framework for policy mirror descent with general parameterization and linear convergence
gan: Alfano, C, et al.
Cyhoeddwyd: (2024)

Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent
gan: Wu, F, et al.
Cyhoeddwyd: (2022)

Dual space preconditioning for gradient descent
gan: Maddison, CJ, et al.
Cyhoeddwyd: (2021)

A Multi-View Fusion Method via Tensor Learning and Gradient Descent for Image Features
gan: Laihang Yu, et al.
Cyhoeddwyd: (2021-01-01)

MODIFIED ARMIJO RULE ON GRADIENT DESCENT AND CONJUGATE GRADIENT
gan: ZURAIDAH FITRIAH, et al.
Cyhoeddwyd: (2017-10-01)

Distributed stochastic gradient descent for link prediction in signed social networks
gan: Han Zhang, et al.
Cyhoeddwyd: (2019-01-01)

Iterative Regularization via Dual Diagonal Descent
gan: Garrigos, Guillaume, et al.
Cyhoeddwyd: (2018)

Carathéodory sampling for stochastic gradient descent
gan: Cosentino, F, et al.
Cyhoeddwyd: (2020)

Carathéodory sampling for stochastic gradient descent
gan: Cosentino, F, et al.
Cyhoeddwyd: (2020)

Amortized Bayesian Meta-Learning with Accelerated Gradient Descent Steps
gan: Zhewei Zhang, et al.
Cyhoeddwyd: (2023-07-01)

Gradient-Descent-like Ghost Imaging
gan: Wen-Kai Yu, et al.
Cyhoeddwyd: (2021-11-01)

Semi-Stochastic Gradient Descent Methods
gan: Jakub Konečný, et al.
Cyhoeddwyd: (2017-05-01)

Correspondence between neuroevolution and gradient descent
gan: Stephen Whitelam, et al.
Cyhoeddwyd: (2021-11-01)

Optimal convergence rate for exact policy mirror descent in discounted Markov decision processes
gan: Johnson, E, et al.
Cyhoeddwyd: (2023)

The complexity of gradient descent: CLS = PPAD ∩ PLS
gan: Fearnley, J, et al.
Cyhoeddwyd: (2021)

The complexity of gradient descent: CLS = PPAD∩PLS
gan: Fearnley, J, et al.
Cyhoeddwyd: (2022)

Efficient neural codes naturally emerge through gradient descent learning
gan: Ari S. Benjamin, et al.
Cyhoeddwyd: (2022-12-01)

Stochastic gradient descent for wind farm optimization
gan: J. Quick, et al.
Cyhoeddwyd: (2023-08-01)

Function approximation method based on weights gradient descent in reinforcement learning
gan: Xiaoyan QIN, et al.
Cyhoeddwyd: (2023-08-01)