Unifying serverless and microservice workloads with SigmaOS
SOSP ’24,, November 4–6, 2024, Austin, TX, USA
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
ACM|ACM SIGOPS 30th Symposium on Operating Systems Principles
2024
|
| Online Access: | https://hdl.handle.net/1721.1/157856 |
| _version_ | 1824458352612081664 |
|---|---|
| author | Szekely, Ariel Belay, Adam Morris, Robert Kaashoek, M. Frans |
| author2 | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory |
| author_facet | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Szekely, Ariel Belay, Adam Morris, Robert Kaashoek, M. Frans |
| author_sort | Szekely, Ariel |
| collection | MIT |
| description | SOSP ’24,, November 4–6, 2024, Austin, TX, USA |
| first_indexed | 2025-02-19T04:24:32Z |
| format | Article |
| id | mit-1721.1/157856 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2025-02-19T04:24:32Z |
| publishDate | 2024 |
| publisher | ACM|ACM SIGOPS 30th Symposium on Operating Systems Principles |
| record_format | dspace |
| spelling | mit-1721.1/1578562025-01-13T04:29:44Z Unifying serverless and microservice workloads with SigmaOS Szekely, Ariel Belay, Adam Morris, Robert Kaashoek, M. Frans Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory SOSP ’24,, November 4–6, 2024, Austin, TX, USA Many cloud applications use both serverless functions, for bursts of stateless parallel computation, and container orchestration, for long-running microservices and tasks that need to interact. Ideally a single platform would offer the union of these systems' capabilities, but neither is sufficient to act as that single platform: serverless functions are lightweight but cannot act as servers with long-term state, while container orchestration offers general-purpose computation but instance start-up takes too long to support burst parallelism. σOS is a new multi-tenant cloud operating system that combines the best of container orchestration and serverless in one platform with one API. σOS computations, called procs, can be long-running, stateful, and interact with each other, making them a good match for both serverless and microservice tasks. A key aspect of the σOS design is its cloud-centric API, which provides flexible management of computation, a novel abstraction for communication endpoints, σEPs---which allow procs of a tenant to communicate efficiently but prohibits procs from sending packets to other tenants---and a flexible naming system to name, for example, σEPs. Quick proc start-up is important for serverless uses. A key enabling observation is that both serverless and microservice applications rely on cloud services for much of the work traditionally done by the local OS (e.g., access to durable storage and additional compute resources). σOS exploits this observation by providing only a small and generic local operating system image to each proc, which can be created much more quickly than a container orchestration instance since σOS need not install application-specific filesystem content or (due to σOS's σEPs) configure an isolated overlay network. Microbenchmarks show that σOS can cold start a proc in 7.7 msec and can create 36,650 procs per second, distributing them over a 24-machine cluster. An evaluation of σOS with two microservice applications from DeathStarBench, a MapReduce application, and an image processing benchmark, shows that the σOS API supports both microservices and lambda-style computations, and provides better performance than corresponding versions on AWS Lambda and Kubernetes. 2024-12-13T22:52:30Z 2024-12-13T22:52:30Z 2024-11-04 2024-12-01T08:53:06Z Article http://purl.org/eprint/type/ConferencePaper 979-8-4007-1251-7 https://hdl.handle.net/1721.1/157856 Szekely, Ariel, Belay, Adam, Morris, Robert and Kaashoek, M. Frans. 2024. "Unifying serverless and microservice workloads with SigmaOS." PUBLISHER_CC en https://doi.org/10.1145/3694715.3695947 Creative Commons Attribution https://creativecommons.org/licenses/by/4.0/ The author(s) application/pdf ACM|ACM SIGOPS 30th Symposium on Operating Systems Principles Association for Computing Machinery |
| spellingShingle | Szekely, Ariel Belay, Adam Morris, Robert Kaashoek, M. Frans Unifying serverless and microservice workloads with SigmaOS |
| title | Unifying serverless and microservice workloads with SigmaOS |
| title_full | Unifying serverless and microservice workloads with SigmaOS |
| title_fullStr | Unifying serverless and microservice workloads with SigmaOS |
| title_full_unstemmed | Unifying serverless and microservice workloads with SigmaOS |
| title_short | Unifying serverless and microservice workloads with SigmaOS |
| title_sort | unifying serverless and microservice workloads with sigmaos |
| url | https://hdl.handle.net/1721.1/157856 |
| work_keys_str_mv | AT szekelyariel unifyingserverlessandmicroserviceworkloadswithsigmaos AT belayadam unifyingserverlessandmicroserviceworkloadswithsigmaos AT morrisrobert unifyingserverlessandmicroserviceworkloadswithsigmaos AT kaashoekmfrans unifyingserverlessandmicroserviceworkloadswithsigmaos |