A joint function warm-up and request routing scheme for performing confident serverless computing
Serverless computing has become increasingly popular recently due to its cost efficiency and flexibility. However, running serverless computing functions in the cloud can incur high end-to-end service latency and operational costs. Running them on edge servers may significantly reduce service latenc...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-09-01
|
| Series: | High-Confidence Computing |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S266729522200023X |
| _version_ | 1828149405721559040 |
|---|---|
| author | Meenakshi Sethunath Yang Peng |
| author_facet | Meenakshi Sethunath Yang Peng |
| author_sort | Meenakshi Sethunath |
| collection | DOAJ |
| description | Serverless computing has become increasingly popular recently due to its cost efficiency and flexibility. However, running serverless computing functions in the cloud can incur high end-to-end service latency and operational costs. Running them on edge servers may significantly reduce service latency but is limited by computing power and memory availability. Given the limitations of cloud and edge environments for performing serverless computing, this paper proposes a joint function warm-up and request routing scheme to perform serverless computing functions on edge and cloud collaboratively. The key idea of the new scheme is to maximize the hit ratio of serverless computing requests, thereby reducing the cold-start latency that dominates the overall serving latency. This scheme explicitly considers allocating server memory and operation budget for executing concurrent requests during the scheduling. The proposed scheme has been evaluated through extensive simulations. Its effectiveness has been proved by comparison with the upper-bound results. |
| first_indexed | 2024-04-11T21:28:48Z |
| format | Article |
| id | doaj.art-bb54b99de5de4f258e4091c8ed78028d |
| institution | Directory Open Access Journal |
| issn | 2667-2952 |
| language | English |
| last_indexed | 2024-04-11T21:28:48Z |
| publishDate | 2022-09-01 |
| publisher | Elsevier |
| record_format | Article |
| series | High-Confidence Computing |
| spelling | doaj.art-bb54b99de5de4f258e4091c8ed78028d2022-12-22T04:02:16ZengElsevierHigh-Confidence Computing2667-29522022-09-0123100071A joint function warm-up and request routing scheme for performing confident serverless computingMeenakshi Sethunath0Yang Peng1Computing and Software Systems, School of STEM, University of Washington Bothell, Bothell, USACorresponding author.; Computing and Software Systems, School of STEM, University of Washington Bothell, Bothell, USAServerless computing has become increasingly popular recently due to its cost efficiency and flexibility. However, running serverless computing functions in the cloud can incur high end-to-end service latency and operational costs. Running them on edge servers may significantly reduce service latency but is limited by computing power and memory availability. Given the limitations of cloud and edge environments for performing serverless computing, this paper proposes a joint function warm-up and request routing scheme to perform serverless computing functions on edge and cloud collaboratively. The key idea of the new scheme is to maximize the hit ratio of serverless computing requests, thereby reducing the cold-start latency that dominates the overall serving latency. This scheme explicitly considers allocating server memory and operation budget for executing concurrent requests during the scheduling. The proposed scheme has been evaluated through extensive simulations. Its effectiveness has been proved by comparison with the upper-bound results.http://www.sciencedirect.com/science/article/pii/S266729522200023XServerless computingEdge computingCloud computingFunction warm-up |
| spellingShingle | Meenakshi Sethunath Yang Peng A joint function warm-up and request routing scheme for performing confident serverless computing High-Confidence Computing Serverless computing Edge computing Cloud computing Function warm-up |
| title | A joint function warm-up and request routing scheme for performing confident serverless computing |
| title_full | A joint function warm-up and request routing scheme for performing confident serverless computing |
| title_fullStr | A joint function warm-up and request routing scheme for performing confident serverless computing |
| title_full_unstemmed | A joint function warm-up and request routing scheme for performing confident serverless computing |
| title_short | A joint function warm-up and request routing scheme for performing confident serverless computing |
| title_sort | joint function warm up and request routing scheme for performing confident serverless computing |
| topic | Serverless computing Edge computing Cloud computing Function warm-up |
| url | http://www.sciencedirect.com/science/article/pii/S266729522200023X |
| work_keys_str_mv | AT meenakshisethunath ajointfunctionwarmupandrequestroutingschemeforperformingconfidentserverlesscomputing AT yangpeng ajointfunctionwarmupandrequestroutingschemeforperformingconfidentserverlesscomputing AT meenakshisethunath jointfunctionwarmupandrequestroutingschemeforperformingconfidentserverlesscomputing AT yangpeng jointfunctionwarmupandrequestroutingschemeforperformingconfidentserverlesscomputing |