Homa: a receiver-driven low-latency transport protocol using network priorities

© 2018 Association for Computing Machinery. Homa is a new transport protocol for datacenter networks. It provides exceptionally low latency, especially for workloads with a high volume of very short messages, and it also supports large messages and high network utilization. Homa uses in-network prio...

Full description

Bibliographic Details
Main Authors: Montazeri, Behnam, Li, Yilong, Alizadeh, Mohammad, Ousterhout, John
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:English
Published: ACM 2021
Online Access:https://hdl.handle.net/1721.1/137384
_version_ 1826201292569051136
author Montazeri, Behnam
Li, Yilong
Alizadeh, Mohammad
Ousterhout, John
author2 Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
author_facet Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Montazeri, Behnam
Li, Yilong
Alizadeh, Mohammad
Ousterhout, John
author_sort Montazeri, Behnam
collection MIT
description © 2018 Association for Computing Machinery. Homa is a new transport protocol for datacenter networks. It provides exceptionally low latency, especially for workloads with a high volume of very short messages, and it also supports large messages and high network utilization. Homa uses in-network priority queues to ensure low latency for short messages; priority allocation is managed dynamically by each receiver and integrated with a receiver-driven flow control mechanism. Homa also uses controlled overcommitment of receiver downlinks to ensure efficient bandwidth utilization at high load. Our implementation of Homa delivers 99th percentile round-trip times less than 15 µs for short messages on a 10 Gbps network running at 80% load. These latencies are almost 100x lower than the best published measurements of an implementation. In simulations, Homa's latency is roughly equal to pFabric and significantly better than pHost, PIAS, and NDP for almost all message sizes and workloads. Homa can also sustain higher network loads than pFabric, pHost, or PIAS.
first_indexed 2024-09-23T11:49:20Z
format Article
id mit-1721.1/137384
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T11:49:20Z
publishDate 2021
publisher ACM
record_format dspace
spelling mit-1721.1/1373842023-06-22T18:44:47Z Homa: a receiver-driven low-latency transport protocol using network priorities Montazeri, Behnam Li, Yilong Alizadeh, Mohammad Ousterhout, John Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory © 2018 Association for Computing Machinery. Homa is a new transport protocol for datacenter networks. It provides exceptionally low latency, especially for workloads with a high volume of very short messages, and it also supports large messages and high network utilization. Homa uses in-network priority queues to ensure low latency for short messages; priority allocation is managed dynamically by each receiver and integrated with a receiver-driven flow control mechanism. Homa also uses controlled overcommitment of receiver downlinks to ensure efficient bandwidth utilization at high load. Our implementation of Homa delivers 99th percentile round-trip times less than 15 µs for short messages on a 10 Gbps network running at 80% load. These latencies are almost 100x lower than the best published measurements of an implementation. In simulations, Homa's latency is roughly equal to pFabric and significantly better than pHost, PIAS, and NDP for almost all message sizes and workloads. Homa can also sustain higher network loads than pFabric, pHost, or PIAS. 2021-11-04T18:11:09Z 2021-11-04T18:11:09Z 2018-08-07 2019-05-02T16:25:05Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/137384 Montazeri, Behnam, Li, Yilong, Alizadeh, Mohammad and Ousterhout, John. 2018. "Homa: a receiver-driven low-latency transport protocol using network priorities." en 10.1145/3230543.3230564 Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf ACM MIT web domain
spellingShingle Montazeri, Behnam
Li, Yilong
Alizadeh, Mohammad
Ousterhout, John
Homa: a receiver-driven low-latency transport protocol using network priorities
title Homa: a receiver-driven low-latency transport protocol using network priorities
title_full Homa: a receiver-driven low-latency transport protocol using network priorities
title_fullStr Homa: a receiver-driven low-latency transport protocol using network priorities
title_full_unstemmed Homa: a receiver-driven low-latency transport protocol using network priorities
title_short Homa: a receiver-driven low-latency transport protocol using network priorities
title_sort homa a receiver driven low latency transport protocol using network priorities
url https://hdl.handle.net/1721.1/137384
work_keys_str_mv AT montazeribehnam homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities
AT liyilong homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities
AT alizadehmohammad homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities
AT ousterhoutjohn homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities