Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances
Cloud provider Amazon Elastic Compute Cloud (EC2) gives access to resources in the form of virtual servers, also known as instances. EC2 spot instances (SIs) offer spare computational capacity at steep discounts compared to reliable and fixed price on-demand instances. The drawback, however, is that...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-07-01
|
| Series: | Algorithms |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1999-4893/13/8/187 |
| _version_ | 1797560637662953472 |
|---|---|
| author | Altino M. Sampaio Jorge G. Barbosa |
| author_facet | Altino M. Sampaio Jorge G. Barbosa |
| author_sort | Altino M. Sampaio |
| collection | DOAJ |
| description | Cloud provider Amazon Elastic Compute Cloud (EC2) gives access to resources in the form of virtual servers, also known as instances. EC2 spot instances (SIs) offer spare computational capacity at steep discounts compared to reliable and fixed price on-demand instances. The drawback, however, is that the delay in acquiring spots can be incredible high. Moreover, SIs may not always be available as they can be reclaimed by EC2 at any given time, with a two-minute interruption notice. In this paper, we propose a multi-workflow scheduling algorithm, allied with a container migration-based mechanism, to dynamically construct and readjust virtual clusters on top of non-reserved EC2 pricing model instances. Our solution leverages recent findings on performance and behavior characteristics of EC2 spots. We conducted simulations by submitting real-life workflow applications, constrained by user-defined deadline and budget quality of service (QoS) parameters. The results indicate that our solution improves the rate of completed tasks by almost 20%, and the rate of completed workflows by at least 30%, compared with other state-of-the-art algorithms, for a worse-case scenario. |
| first_indexed | 2024-03-10T18:03:26Z |
| format | Article |
| id | doaj.art-ad0bddb188a44bf9bffa5ddf72345cb7 |
| institution | Directory Open Access Journal |
| issn | 1999-4893 |
| language | English |
| last_indexed | 2024-03-10T18:03:26Z |
| publishDate | 2020-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Algorithms |
| spelling | doaj.art-ad0bddb188a44bf9bffa5ddf72345cb72023-11-20T08:42:57ZengMDPI AGAlgorithms1999-48932020-07-0113818710.3390/a13080187Constructing Reliable Computing Environments on Top of Amazon EC2 Spot InstancesAltino M. Sampaio0Jorge G. Barbosa1CIICESI, Escola Superior de Tecnologia e Gestão, Instituto Politécnico do Porto, 4610-156 Felgueiras, PortugalLIACC, Departamento de Engenharia Informática, Faculdade de Engenharia, Universidade do Porto, 4200-465 Porto, PortugalCloud provider Amazon Elastic Compute Cloud (EC2) gives access to resources in the form of virtual servers, also known as instances. EC2 spot instances (SIs) offer spare computational capacity at steep discounts compared to reliable and fixed price on-demand instances. The drawback, however, is that the delay in acquiring spots can be incredible high. Moreover, SIs may not always be available as they can be reclaimed by EC2 at any given time, with a two-minute interruption notice. In this paper, we propose a multi-workflow scheduling algorithm, allied with a container migration-based mechanism, to dynamically construct and readjust virtual clusters on top of non-reserved EC2 pricing model instances. Our solution leverages recent findings on performance and behavior characteristics of EC2 spots. We conducted simulations by submitting real-life workflow applications, constrained by user-defined deadline and budget quality of service (QoS) parameters. The results indicate that our solution improves the rate of completed tasks by almost 20%, and the rate of completed workflows by at least 30%, compared with other state-of-the-art algorithms, for a worse-case scenario.https://www.mdpi.com/1999-4893/13/8/187cloud computingamazon EC2 (Elastic Compute Cloud)spot instancesreliabilityschedulingworkflow applications |
| spellingShingle | Altino M. Sampaio Jorge G. Barbosa Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances Algorithms cloud computing amazon EC2 (Elastic Compute Cloud) spot instances reliability scheduling workflow applications |
| title | Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances |
| title_full | Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances |
| title_fullStr | Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances |
| title_full_unstemmed | Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances |
| title_short | Constructing Reliable Computing Environments on Top of Amazon EC2 Spot Instances |
| title_sort | constructing reliable computing environments on top of amazon ec2 spot instances |
| topic | cloud computing amazon EC2 (Elastic Compute Cloud) spot instances reliability scheduling workflow applications |
| url | https://www.mdpi.com/1999-4893/13/8/187 |
| work_keys_str_mv | AT altinomsampaio constructingreliablecomputingenvironmentsontopofamazonec2spotinstances AT jorgegbarbosa constructingreliablecomputingenvironmentsontopofamazonec2spotinstances |