Lower Bounds on Information Transfer in Distributed Computations

We derive a lower bound on the interprocessor information transfer required for computing a function in a distributed network. The bound is expressed in terms of the function's derivatives, and we use it to exhibit functions whose computation requires a great deal of interprocess communication....

Full description

Bibliographic Details
Main Author: Abelson, Harold
Published: 2023
Online Access:https://hdl.handle.net/1721.1/148930
Description
Summary:We derive a lower bound on the interprocessor information transfer required for computing a function in a distributed network. The bound is expressed in terms of the function's derivatives, and we use it to exhibit functions whose computation requires a great deal of interprocess communication. As a sample application, we give lower bounds on information transfer in the distributed computation of some typical matrix operations.