No Bits Left Behind
One of the key tenets of database system design is making efficient use of storage and memory resources. However, existing database system implementations are actually extremely wasteful of such resources; for example, most systems leave a great deal of empty space in tuples, index pages, and da...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
CIDR Conference
2011
|
| Online Access: | http://hdl.handle.net/1721.1/62302 https://orcid.org/0000-0002-7470-3265 |
| _version_ | 1811073324228280320 |
|---|---|
| author | Wu, Eugene Curino, Carlo Madden, Samuel R. |
| author2 | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory |
| author_facet | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Wu, Eugene Curino, Carlo Madden, Samuel R. |
| author_sort | Wu, Eugene |
| collection | MIT |
| description | One of the key tenets of database system design is making efficient
use of storage and memory resources. However, existing database
system implementations are actually extremely wasteful of such
resources; for example, most systems leave a great deal of empty
space in tuples, index pages, and data pages, and spend many
CPU cycles reading cold records from disk that are never used.
In this paper, we identify a number of such sources of waste, and
present a series of techniques that limit this waste (e.g., forcing
better memory locality for hot data and using empty space in index
pages to cache popular tuples) without substantially complicating
interfaces or system design. We show that these techniques
effectively reduce memory requirements for real scenarios from
the Wikipedia database (by up to 17.8×) while increasing query
performance (by up to 8×). |
| first_indexed | 2024-09-23T09:31:17Z |
| format | Article |
| id | mit-1721.1/62302 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T09:31:17Z |
| publishDate | 2011 |
| publisher | CIDR Conference |
| record_format | dspace |
| spelling | mit-1721.1/623022022-09-26T11:59:30Z No Bits Left Behind Wu, Eugene Curino, Carlo Madden, Samuel R. Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Madden, Samuel R. Wu, Eugene Curino, Carlo Madden, Samuel R. One of the key tenets of database system design is making efficient use of storage and memory resources. However, existing database system implementations are actually extremely wasteful of such resources; for example, most systems leave a great deal of empty space in tuples, index pages, and data pages, and spend many CPU cycles reading cold records from disk that are never used. In this paper, we identify a number of such sources of waste, and present a series of techniques that limit this waste (e.g., forcing better memory locality for hot data and using empty space in index pages to cache popular tuples) without substantially complicating interfaces or system design. We show that these techniques effectively reduce memory requirements for real scenarios from the Wikipedia database (by up to 17.8×) while increasing query performance (by up to 8×). 2011-04-22T18:49:48Z 2011-04-22T18:49:48Z 2011-01 Article http://purl.org/eprint/type/ConferencePaper http://hdl.handle.net/1721.1/62302 Wu, Eugene, Carlo Curino, Samuel Madden. "No Bits Left Behind." 5th Biennial Conference on Innovative Data Systems Research, Jan. 9-12, 2011. [Papers] pp. 187-190. https://orcid.org/0000-0002-7470-3265 en_US http://www.cidrdb.org/cidr2011/Papers/CIDR11_Paper23.pdf Conference on Innovative Systems Research (CIDR) Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf CIDR Conference MIT web domain |
| spellingShingle | Wu, Eugene Curino, Carlo Madden, Samuel R. No Bits Left Behind |
| title | No Bits Left Behind |
| title_full | No Bits Left Behind |
| title_fullStr | No Bits Left Behind |
| title_full_unstemmed | No Bits Left Behind |
| title_short | No Bits Left Behind |
| title_sort | no bits left behind |
| url | http://hdl.handle.net/1721.1/62302 https://orcid.org/0000-0002-7470-3265 |
| work_keys_str_mv | AT wueugene nobitsleftbehind AT curinocarlo nobitsleftbehind AT maddensamuelr nobitsleftbehind |