A study of resource management policies for function-as-a-service
Function as a Service (FaaS) offers a novel way to deploy computing applications to serverless backends in the cloud. This evolving paradigm shifts more control of resource management from the cloud users to the cloud providers. Despite the benefits of FaaS, cold start problems significantly impact...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis-Master by Research |
| Language: | English |
| Published: |
Nanyang Technological University
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/166480 |
| _version_ | 1826111811148054528 |
|---|---|
| author | Lin, Yukun |
| author2 | Tang Xueyan |
| author_facet | Tang Xueyan Lin, Yukun |
| author_sort | Lin, Yukun |
| collection | NTU |
| description | Function as a Service (FaaS) offers a novel way to deploy computing applications to serverless backends in the cloud. This evolving paradigm shifts more control of resource management from the cloud users to the cloud providers. Despite the benefits of FaaS, cold start problems significantly impact its performance. To alleviate such effects, cloud providers often pre-warm containers or maintain a container pool to respond quickly to unforeseen requests. This exposes a trade-off between performance and resource consumption. However, various request patterns of functions make it difficult to achieve targeted optimization for cloud providers of universal FaaS platforms. We seek to optimize a general-purpose FaaS platform, Fission, in terms of managing both container termination and container specialization. A pod termination policy is proposed to manage the termination of idle pods by dynamically changing their expiry times. We also modify the workflow of processing requests in Fission and develop a pod specialization policy. We evaluate the performance of our policies on a simulator with a public dataset from Microsoft Azure. According to the results obtained, the proposed pod termination policy adapts to the workload of different intensities and offers better performance than the default policy of Fission. In addition, the pod specialization policy reduces the average processing latency of requests, while maintaining or slightly reducing the idle time of pods. |
| first_indexed | 2024-10-01T02:56:55Z |
| format | Thesis-Master by Research |
| id | ntu-10356/166480 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T02:56:55Z |
| publishDate | 2023 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1664802023-05-02T06:33:01Z A study of resource management policies for function-as-a-service Lin, Yukun Tang Xueyan School of Computer Science and Engineering ASXYTang@ntu.edu.sg Engineering::Computer science and engineering Function as a Service (FaaS) offers a novel way to deploy computing applications to serverless backends in the cloud. This evolving paradigm shifts more control of resource management from the cloud users to the cloud providers. Despite the benefits of FaaS, cold start problems significantly impact its performance. To alleviate such effects, cloud providers often pre-warm containers or maintain a container pool to respond quickly to unforeseen requests. This exposes a trade-off between performance and resource consumption. However, various request patterns of functions make it difficult to achieve targeted optimization for cloud providers of universal FaaS platforms. We seek to optimize a general-purpose FaaS platform, Fission, in terms of managing both container termination and container specialization. A pod termination policy is proposed to manage the termination of idle pods by dynamically changing their expiry times. We also modify the workflow of processing requests in Fission and develop a pod specialization policy. We evaluate the performance of our policies on a simulator with a public dataset from Microsoft Azure. According to the results obtained, the proposed pod termination policy adapts to the workload of different intensities and offers better performance than the default policy of Fission. In addition, the pod specialization policy reduces the average processing latency of requests, while maintaining or slightly reducing the idle time of pods. Master of Engineering 2023-04-28T01:42:50Z 2023-04-28T01:42:50Z 2023 Thesis-Master by Research Lin, Y. (2023). A study of resource management policies for function-as-a-service. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/166480 https://hdl.handle.net/10356/166480 10.32657/10356/166480 en This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0). application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering Lin, Yukun A study of resource management policies for function-as-a-service |
| title | A study of resource management policies for function-as-a-service |
| title_full | A study of resource management policies for function-as-a-service |
| title_fullStr | A study of resource management policies for function-as-a-service |
| title_full_unstemmed | A study of resource management policies for function-as-a-service |
| title_short | A study of resource management policies for function-as-a-service |
| title_sort | study of resource management policies for function as a service |
| topic | Engineering::Computer science and engineering |
| url | https://hdl.handle.net/10356/166480 |
| work_keys_str_mv | AT linyukun astudyofresourcemanagementpoliciesforfunctionasaservice AT linyukun studyofresourcemanagementpoliciesforfunctionasaservice |