Building Instance Aware Systems using Explicit Performance Modeling
Computer systems are often optimized to realize the best performance possible. However, these optimization techniques are typically blind to the system’s actual workload or the particular environment in which the system is deployed. The lack of awareness of the full picture, or “instance”, limits th...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/143317 https://orcid.org/0000-0003-0189-0271 |
| _version_ | 1826189764911431680 |
|---|---|
| author | Nathan, Vikram |
| author2 | Alizadeh, Mohammad |
| author_facet | Alizadeh, Mohammad Nathan, Vikram |
| author_sort | Nathan, Vikram |
| collection | MIT |
| description | Computer systems are often optimized to realize the best performance possible. However, these optimization techniques are typically blind to the system’s actual workload or the particular environment in which the system is deployed. The lack of awareness of the full picture, or “instance”, limits the extent to which a system’s performance can be improved. However, achieving instance awareness is difficult because it involves optimizing over a large search space of configurable parameters. This thesis explores the use of explicit performance modeling in the context of three different systems to accelerate this optimization process and therefore make instance awareness practical:
Flood is a multidimensional database index that is tuned for both lowest latency and minimal space overhead on a query distribution known ahead of time. Flood uses a simple grid-based index system that adjusts the number of partitions in each dimension based on the workload. The “knobs” Flood turns are the parameters of this grid, making it more flexible than existing indexes, which have fewer such knobs. Flood models system performance as a combination of features determined by these grid parameters, and uses explicit measurement to train this model.
Cortex is a correlation index that allows databases to index attributes correlated to already-indexed attributes with minimal additional overhead but substantial performance improvement. Cortex decides which points should be considered outliers and inliers in the correlation; this fine grained control is the set of knobs that Cortex needs to instance optimize its performance: for the hardware its on, the host index on the database, and the distribution of queries.
Minerva is an end-to-end transport algorithm for video streaming, which aims to achieve Quality-of-Experience fairness, so all clients sharing a bottleneck link in the network have roughly equal picture quality and minimal stalls. Importantly, this is achieved without compromising the bandwidth share of non-video traffic and without any client knowing about the others’ existence. Minerva achieves fairness by making the network instance aware, using information about the client’s state and the videos being streamed to model the client’s performance and scale the aggressiveness of its congestion control algorithm. |
| first_indexed | 2024-09-23T08:21:11Z |
| format | Thesis |
| id | mit-1721.1/143317 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T08:21:11Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1433172022-06-16T03:56:19Z Building Instance Aware Systems using Explicit Performance Modeling Nathan, Vikram Alizadeh, Mohammad Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Computer systems are often optimized to realize the best performance possible. However, these optimization techniques are typically blind to the system’s actual workload or the particular environment in which the system is deployed. The lack of awareness of the full picture, or “instance”, limits the extent to which a system’s performance can be improved. However, achieving instance awareness is difficult because it involves optimizing over a large search space of configurable parameters. This thesis explores the use of explicit performance modeling in the context of three different systems to accelerate this optimization process and therefore make instance awareness practical: Flood is a multidimensional database index that is tuned for both lowest latency and minimal space overhead on a query distribution known ahead of time. Flood uses a simple grid-based index system that adjusts the number of partitions in each dimension based on the workload. The “knobs” Flood turns are the parameters of this grid, making it more flexible than existing indexes, which have fewer such knobs. Flood models system performance as a combination of features determined by these grid parameters, and uses explicit measurement to train this model. Cortex is a correlation index that allows databases to index attributes correlated to already-indexed attributes with minimal additional overhead but substantial performance improvement. Cortex decides which points should be considered outliers and inliers in the correlation; this fine grained control is the set of knobs that Cortex needs to instance optimize its performance: for the hardware its on, the host index on the database, and the distribution of queries. Minerva is an end-to-end transport algorithm for video streaming, which aims to achieve Quality-of-Experience fairness, so all clients sharing a bottleneck link in the network have roughly equal picture quality and minimal stalls. Importantly, this is achieved without compromising the bandwidth share of non-video traffic and without any client knowing about the others’ existence. Minerva achieves fairness by making the network instance aware, using information about the client’s state and the videos being streamed to model the client’s performance and scale the aggressiveness of its congestion control algorithm. Ph.D. 2022-06-15T13:12:04Z 2022-06-15T13:12:04Z 2022-02 2022-03-04T20:47:44.601Z Thesis https://hdl.handle.net/1721.1/143317 https://orcid.org/0000-0003-0189-0271 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Nathan, Vikram Building Instance Aware Systems using Explicit Performance Modeling |
| title | Building Instance Aware Systems using Explicit Performance Modeling |
| title_full | Building Instance Aware Systems using Explicit Performance Modeling |
| title_fullStr | Building Instance Aware Systems using Explicit Performance Modeling |
| title_full_unstemmed | Building Instance Aware Systems using Explicit Performance Modeling |
| title_short | Building Instance Aware Systems using Explicit Performance Modeling |
| title_sort | building instance aware systems using explicit performance modeling |
| url | https://hdl.handle.net/1721.1/143317 https://orcid.org/0000-0003-0189-0271 |
| work_keys_str_mv | AT nathanvikram buildinginstanceawaresystemsusingexplicitperformancemodeling |