P4xos: consensus as a network service

In this paper, we explore how a programmable forwarding plane offered by a new breed of network switches might naturally accelerate consensus protocols, specifically focusing on Paxos. The performance of consensus protocols has long been a concern. By implementing Paxos in the forwarding plane, we a...

Full description

Bibliographic Details
Main Authors: Dang, HT, Bressana, P, Wang, H, Lee, KS, Zilberman, N, Hakim, W, Canini, M, Pedone, F, Soule, R
Format: Journal article
Language:English
Published: Institute of Electrical and Electronics Engineers 2020
_version_ 1797075134853414912
author Dang, HT
Bressana, P
Wang, H
Lee, KS
Zilberman, N
Hakim, W
Canini, M
Pedone, F
Soule, R
author_facet Dang, HT
Bressana, P
Wang, H
Lee, KS
Zilberman, N
Hakim, W
Canini, M
Pedone, F
Soule, R
author_sort Dang, HT
collection OXFORD
description In this paper, we explore how a programmable forwarding plane offered by a new breed of network switches might naturally accelerate consensus protocols, specifically focusing on Paxos. The performance of consensus protocols has long been a concern. By implementing Paxos in the forwarding plane, we are able to significantly increase throughput and reduce latency. Our P4-based implementation running on an ASIC in isolation can process over 2.5 billion consensus messages per second, a four orders of magnitude improvement in throughput over a widely-used software implementation. This effectively removes consensus as a bottleneck for distributed applications in data centers. Beyond sheer performance, our approach offers several other important benefits: it readily lends itself to formal verification; it does not rely on any additional network hardware; and as a full Paxos implementation, it makes only very weak assumptions about the network.
first_indexed 2024-03-06T23:46:02Z
format Journal article
id oxford-uuid:70eaffdd-9041-4738-b432-ea04d6712977
institution University of Oxford
language English
last_indexed 2024-03-06T23:46:02Z
publishDate 2020
publisher Institute of Electrical and Electronics Engineers
record_format dspace
spelling oxford-uuid:70eaffdd-9041-4738-b432-ea04d67129772022-03-26T19:40:29ZP4xos: consensus as a network serviceJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:70eaffdd-9041-4738-b432-ea04d6712977EnglishSymplectic ElementsInstitute of Electrical and Electronics Engineers2020Dang, HTBressana, PWang, HLee, KSZilberman, NHakim, WCanini, MPedone, FSoule, RIn this paper, we explore how a programmable forwarding plane offered by a new breed of network switches might naturally accelerate consensus protocols, specifically focusing on Paxos. The performance of consensus protocols has long been a concern. By implementing Paxos in the forwarding plane, we are able to significantly increase throughput and reduce latency. Our P4-based implementation running on an ASIC in isolation can process over 2.5 billion consensus messages per second, a four orders of magnitude improvement in throughput over a widely-used software implementation. This effectively removes consensus as a bottleneck for distributed applications in data centers. Beyond sheer performance, our approach offers several other important benefits: it readily lends itself to formal verification; it does not rely on any additional network hardware; and as a full Paxos implementation, it makes only very weak assumptions about the network.
spellingShingle Dang, HT
Bressana, P
Wang, H
Lee, KS
Zilberman, N
Hakim, W
Canini, M
Pedone, F
Soule, R
P4xos: consensus as a network service
title P4xos: consensus as a network service
title_full P4xos: consensus as a network service
title_fullStr P4xos: consensus as a network service
title_full_unstemmed P4xos: consensus as a network service
title_short P4xos: consensus as a network service
title_sort p4xos consensus as a network service
work_keys_str_mv AT danght p4xosconsensusasanetworkservice
AT bressanap p4xosconsensusasanetworkservice
AT wangh p4xosconsensusasanetworkservice
AT leeks p4xosconsensusasanetworkservice
AT zilbermann p4xosconsensusasanetworkservice
AT hakimw p4xosconsensusasanetworkservice
AT caninim p4xosconsensusasanetworkservice
AT pedonef p4xosconsensusasanetworkservice
AT souler p4xosconsensusasanetworkservice