On Consensus-Optimality Trade-offs in Collaborative Deep Learning
In distributed machine learning, where agents collaboratively learn from diverse private data sets, there is a fundamental tension between consensus and optimality. In this paper, we build on recent algorithmic progresses in distributed deep learning to explore various consensus-optimality trade-off...
Main Authors: | Zhanhong Jiang, Aditya Balu, Chinmay Hegde, Soumik Sarkar |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2021-09-01
|
Series: | Frontiers in Artificial Intelligence |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/frai.2021.573731/full |
Similar Items
-
Communication-Efficient Distributed SGD with Error-Feedback, Revisited
by: Tran Thi Phuong, et al.
Published: (2021-04-01) -
Distributed SGD With Flexible Gradient Compression
by: Tran Thi Phuong, et al.
Published: (2020-01-01) -
Collaborative Optimization of Distributed Scheduling Based on Blockchain Consensus Mechanism Considering Battery-Swap Stations of Electric Vehicles
by: Wei Hu, et al.
Published: (2019-01-01) -
Smart GreenGrocer: Automatic Vegetable Type Classification Using the CNN Algorithm
by: Raden Bagus Muhammad AdryanPutra Adhy Wijaya, et al.
Published: (2023-07-01) -
Distributed Constrained Consensus of Utilities via a Self Evaluation Approach
by: Xiaochu Wang, et al.
Published: (2019-01-01)