On Consensus-Optimality Trade-offs in Collaborative Deep Learning

In distributed machine learning, where agents collaboratively learn from diverse private data sets, there is a fundamental tension between consensus and optimality. In this paper, we build on recent algorithmic progresses in distributed deep learning to explore various consensus-optimality trade-off...

Full description

Bibliographic Details
Main Authors: Zhanhong Jiang, Aditya Balu, Chinmay Hegde, Soumik Sarkar
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-09-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2021.573731/full