Homa: a receiver-driven low-latency transport protocol using network priorities
© 2018 Association for Computing Machinery. Homa is a new transport protocol for datacenter networks. It provides exceptionally low latency, especially for workloads with a high volume of very short messages, and it also supports large messages and high network utilization. Homa uses in-network prio...
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
ACM
2021
|
Online Access: | https://hdl.handle.net/1721.1/137384 |
_version_ | 1826201292569051136 |
---|---|
author | Montazeri, Behnam Li, Yilong Alizadeh, Mohammad Ousterhout, John |
author2 | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
author_facet | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Montazeri, Behnam Li, Yilong Alizadeh, Mohammad Ousterhout, John |
author_sort | Montazeri, Behnam |
collection | MIT |
description | © 2018 Association for Computing Machinery. Homa is a new transport protocol for datacenter networks. It provides exceptionally low latency, especially for workloads with a high volume of very short messages, and it also supports large messages and high network utilization. Homa uses in-network priority queues to ensure low latency for short messages; priority allocation is managed dynamically by each receiver and integrated with a receiver-driven flow control mechanism. Homa also uses controlled overcommitment of receiver downlinks to ensure efficient bandwidth utilization at high load. Our implementation of Homa delivers 99th percentile round-trip times less than 15 µs for short messages on a 10 Gbps network running at 80% load. These latencies are almost 100x lower than the best published measurements of an implementation. In simulations, Homa's latency is roughly equal to pFabric and significantly better than pHost, PIAS, and NDP for almost all message sizes and workloads. Homa can also sustain higher network loads than pFabric, pHost, or PIAS. |
first_indexed | 2024-09-23T11:49:20Z |
format | Article |
id | mit-1721.1/137384 |
institution | Massachusetts Institute of Technology |
language | English |
last_indexed | 2024-09-23T11:49:20Z |
publishDate | 2021 |
publisher | ACM |
record_format | dspace |
spelling | mit-1721.1/1373842023-06-22T18:44:47Z Homa: a receiver-driven low-latency transport protocol using network priorities Montazeri, Behnam Li, Yilong Alizadeh, Mohammad Ousterhout, John Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory © 2018 Association for Computing Machinery. Homa is a new transport protocol for datacenter networks. It provides exceptionally low latency, especially for workloads with a high volume of very short messages, and it also supports large messages and high network utilization. Homa uses in-network priority queues to ensure low latency for short messages; priority allocation is managed dynamically by each receiver and integrated with a receiver-driven flow control mechanism. Homa also uses controlled overcommitment of receiver downlinks to ensure efficient bandwidth utilization at high load. Our implementation of Homa delivers 99th percentile round-trip times less than 15 µs for short messages on a 10 Gbps network running at 80% load. These latencies are almost 100x lower than the best published measurements of an implementation. In simulations, Homa's latency is roughly equal to pFabric and significantly better than pHost, PIAS, and NDP for almost all message sizes and workloads. Homa can also sustain higher network loads than pFabric, pHost, or PIAS. 2021-11-04T18:11:09Z 2021-11-04T18:11:09Z 2018-08-07 2019-05-02T16:25:05Z Article http://purl.org/eprint/type/ConferencePaper https://hdl.handle.net/1721.1/137384 Montazeri, Behnam, Li, Yilong, Alizadeh, Mohammad and Ousterhout, John. 2018. "Homa: a receiver-driven low-latency transport protocol using network priorities." en 10.1145/3230543.3230564 Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf ACM MIT web domain |
spellingShingle | Montazeri, Behnam Li, Yilong Alizadeh, Mohammad Ousterhout, John Homa: a receiver-driven low-latency transport protocol using network priorities |
title | Homa: a receiver-driven low-latency transport protocol using network priorities |
title_full | Homa: a receiver-driven low-latency transport protocol using network priorities |
title_fullStr | Homa: a receiver-driven low-latency transport protocol using network priorities |
title_full_unstemmed | Homa: a receiver-driven low-latency transport protocol using network priorities |
title_short | Homa: a receiver-driven low-latency transport protocol using network priorities |
title_sort | homa a receiver driven low latency transport protocol using network priorities |
url | https://hdl.handle.net/1721.1/137384 |
work_keys_str_mv | AT montazeribehnam homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities AT liyilong homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities AT alizadehmohammad homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities AT ousterhoutjohn homaareceiverdrivenlowlatencytransportprotocolusingnetworkpriorities |