Decentralised learning with distributed gradient descent and random features

Decentralised learning with distributed gradient descent and random features

We investigate the generalisation performance of Distributed Gradient Descent with implicit regularisation and random features in the homogenous setting where a network of agents are given data sampled independently from the same unknown distribution. Along with reducing the memory footprint, random...

书目详细资料
Main Authors:	Richards, D, Rebeschini, P, Rosasco, L
格式:	Conference item
语言:	English
出版:	Proceedings of Machine Learning Research 2020

相似书籍

Robust gradient descent for phase retrieval
由: Buna-Marginean, A, et al.
出版: (2025)

Graph-dependent implicit regularisation for distributed stochastic subgradient descent
由: Richards, D, et al.
出版: (2020)

Generalization bounds for label noise stochastic gradient descent
由: Huh, JE, et al.
出版: (2023)

Generalization bounds for label noise stochastic gradient descent
由: Huh, JE, et al.
出版: (2024)

Optimal statistical rates for decentralised non-parametric regression with linear speed-up
由: Richards, D, et al.
出版: (2019)

Learning mirror maps in policy mirror descent
由: Alfano, C, et al.
出版: (2025)

Implicit regularization in matrix sensing via mirror descent
由: Wu, F, et al.
出版: (2021)

The statistical complexity of early-stopped mirror descent
由: Vaškevičius, T, et al.
出版: (2020)

The statistical complexity of early-stopped mirror descent
由: Kanade, V, et al.
出版: (2023)

Why random reshuffling beats stochastic gradient descent
由: Gürbüzbalaban, M., et al.
出版: (2021)

A continuous-time mirror descent approach to sparse phase retrieval
由: Wu, F, et al.
出版: (2020)

Decentralised federated learning with adaptive partial gradient aggregation
由: Jingyan Jiang, et al.
出版: (2020-05-01)

Distributed machine learning with sparse heterogeneous data
由: Richards, D, et al.
出版: (2021)

Distributed Stochastic Gradient Descent With Compressed and Skipped Communication
由: Tran Thi Phuong, et al.
出版: (2023-01-01)

Limited Gradient Descent: Learning With Noisy Labels
由: Yi Sun, et al.
出版: (2019-01-01)

Featured Hybrid Recommendation System Using Stochastic Gradient Descent
由: Si Thin Nguyen, et al.
出版: (2021-01-01)

Low-Rank Gradient Descent
由: Romain Cosson, et al.
出版: (2023-01-01)

On-manifold projected gradient descent
由: Aaron Mahler, et al.
出版: (2024-02-01)

Multi-task gradient descent for multi-task learning
由: Bai, Lu, et al.
出版: (2021)

Recent Advances in Stochastic Gradient Descent in Deep Learning
由: Yingjie Tian, et al.
出版: (2023-01-01)

Multileave gradient descent for fast online learning to rank
由: Whiteson, S, et al.
出版: (2016)

A novel framework for policy mirror descent with general parameterization and linear convergence
由: Alfano, C, et al.
出版: (2024)

Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent
由: Wu, F, et al.
出版: (2022)

Dual space preconditioning for gradient descent
由: Maddison, CJ, et al.
出版: (2021)

A Multi-View Fusion Method via Tensor Learning and Gradient Descent for Image Features
由: Laihang Yu, et al.
出版: (2021-01-01)

MODIFIED ARMIJO RULE ON GRADIENT DESCENT AND CONJUGATE GRADIENT
由: ZURAIDAH FITRIAH, et al.
出版: (2017-10-01)

Distributed stochastic gradient descent for link prediction in signed social networks
由: Han Zhang, et al.
出版: (2019-01-01)

Iterative Regularization via Dual Diagonal Descent
由: Garrigos, Guillaume, et al.
出版: (2018)

Carathéodory sampling for stochastic gradient descent
由: Cosentino, F, et al.
出版: (2020)

Carathéodory sampling for stochastic gradient descent
由: Cosentino, F, et al.
出版: (2020)

Amortized Bayesian Meta-Learning with Accelerated Gradient Descent Steps
由: Zhewei Zhang, et al.
出版: (2023-07-01)

Gradient-Descent-like Ghost Imaging
由: Wen-Kai Yu, et al.
出版: (2021-11-01)

Semi-Stochastic Gradient Descent Methods
由: Jakub Konečný, et al.
出版: (2017-05-01)

Correspondence between neuroevolution and gradient descent
由: Stephen Whitelam, et al.
出版: (2021-11-01)

Optimal convergence rate for exact policy mirror descent in discounted Markov decision processes
由: Johnson, E, et al.
出版: (2023)

The complexity of gradient descent: CLS = PPAD ∩ PLS
由: Fearnley, J, et al.
出版: (2021)

The complexity of gradient descent: CLS = PPAD∩PLS
由: Fearnley, J, et al.
出版: (2022)

Efficient neural codes naturally emerge through gradient descent learning
由: Ari S. Benjamin, et al.
出版: (2022-12-01)

Stochastic gradient descent for wind farm optimization
由: J. Quick, et al.
出版: (2023-08-01)

Function approximation method based on weights gradient descent in reinforcement learning
由: Xiaoyan QIN, et al.
出版: (2023-08-01)