Communication-Efficient Distributed SGD with Error-Feedback, Revisited

Communication-Efficient Distributed SGD with Error-Feedback, Revisited

We show that the convergence proof of a recent algorithm called dist-EF-SGD for distributed stochastic gradient descent with communication efficiency using error-feedback of Zheng et al., Communication-efficient distributed blockwise momentum SGD with error-feedback, in Advances in Neural Informatio...

Full description

Bibliographic Details
Main Authors: Tran Thi Phuong, Le Trieu Phong
Format: Article
Language:English
Published: Springer 2021-04-01
Series:International Journal of Computational Intelligence Systems
Subjects:
Optimizer
Distributed learning
SGD
Error-feedback
Deep neural networks
Online Access:https://www.atlantis-press.com/article/125955624/view

Internet

https://www.atlantis-press.com/article/125955624/view

Similar Items