Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory
With the advantage of faster data access than traditional disks, in-memory database systems, such as Redis and Memcached, have been widely applied in data centers and embedded systems. The performance of in-memory database greatly depends on the access speed of memory. With the requirement of high b...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-12-01
|
| Series: | Micromachines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-666X/13/1/52 |
| _version_ | 1797491923375620096 |
|---|---|
| author | Wenze Zhao Yajuan Du Mingzhe Zhang Mingyang Liu Kailun Jin Rachata Ausavarungnirun |
| author_facet | Wenze Zhao Yajuan Du Mingzhe Zhang Mingyang Liu Kailun Jin Rachata Ausavarungnirun |
| author_sort | Wenze Zhao |
| collection | DOAJ |
| description | With the advantage of faster data access than traditional disks, in-memory database systems, such as Redis and Memcached, have been widely applied in data centers and embedded systems. The performance of in-memory database greatly depends on the access speed of memory. With the requirement of high bandwidth and low energy, die-stacked memory (e.g., High Bandwidth Memory (HBM)) has been developed to extend the channel number and width. However, the capacity of die-stacked memory is limited due to the interposer challenge. Thus, hybrid memory system with traditional Dynamic Random Access Memory (DRAM) and die-stacked memory emerges. Existing works have proposed to place and manage data on hybrid memory architecture in the view of hardware. This paper considers to manage in-memory database data in hybrid memory in the view of application. We first perform a preliminary study on the hotness distribution of client requests on Redis. From the results, we observe that most requests happen on a small portion of data objects in in-memory database. Then, we propose the Application-oriented Data Migration called ADM to accelerate in-memory database on hybrid memory. We design a hotness management method and two migration policies to migrate data into or out of HBM. We take Redis under comprehensive benchmarks as a case study for the proposed method. Through the experimental results, it is verified that our proposed method can effectively gain performance improvement and reduce energy consumption compared with existing Redis database. |
| first_indexed | 2024-03-10T00:56:11Z |
| format | Article |
| id | doaj.art-d8839eca24ed445994ceb8454a1038e2 |
| institution | Directory Open Access Journal |
| issn | 2072-666X |
| language | English |
| last_indexed | 2024-03-10T00:56:11Z |
| publishDate | 2021-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Micromachines |
| spelling | doaj.art-d8839eca24ed445994ceb8454a1038e22023-11-23T14:44:08ZengMDPI AGMicromachines2072-666X2021-12-011315210.3390/mi13010052Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid MemoryWenze Zhao0Yajuan Du1Mingzhe Zhang2Mingyang Liu3Kailun Jin4Rachata Ausavarungnirun5School of Computer and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Computer and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, ChinaInstitute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, ChinaSchool of Computer and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Computer and Artificial Intelligence, Wuhan University of Technology, Wuhan 430070, ChinaSirindhorn International Thai-German Graduate School of Engineering, King Mongkut’s University of Technology North Bangkok (KMUTNB), Bangkok 10800, ThailandWith the advantage of faster data access than traditional disks, in-memory database systems, such as Redis and Memcached, have been widely applied in data centers and embedded systems. The performance of in-memory database greatly depends on the access speed of memory. With the requirement of high bandwidth and low energy, die-stacked memory (e.g., High Bandwidth Memory (HBM)) has been developed to extend the channel number and width. However, the capacity of die-stacked memory is limited due to the interposer challenge. Thus, hybrid memory system with traditional Dynamic Random Access Memory (DRAM) and die-stacked memory emerges. Existing works have proposed to place and manage data on hybrid memory architecture in the view of hardware. This paper considers to manage in-memory database data in hybrid memory in the view of application. We first perform a preliminary study on the hotness distribution of client requests on Redis. From the results, we observe that most requests happen on a small portion of data objects in in-memory database. Then, we propose the Application-oriented Data Migration called ADM to accelerate in-memory database on hybrid memory. We design a hotness management method and two migration policies to migrate data into or out of HBM. We take Redis under comprehensive benchmarks as a case study for the proposed method. Through the experimental results, it is verified that our proposed method can effectively gain performance improvement and reduce energy consumption compared with existing Redis database.https://www.mdpi.com/2072-666X/13/1/52in-memory databasehybrid memorydata migration |
| spellingShingle | Wenze Zhao Yajuan Du Mingzhe Zhang Mingyang Liu Kailun Jin Rachata Ausavarungnirun Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory Micromachines in-memory database hybrid memory data migration |
| title | Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory |
| title_full | Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory |
| title_fullStr | Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory |
| title_full_unstemmed | Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory |
| title_short | Application-Oriented Data Migration to Accelerate In-Memory Database on Hybrid Memory |
| title_sort | application oriented data migration to accelerate in memory database on hybrid memory |
| topic | in-memory database hybrid memory data migration |
| url | https://www.mdpi.com/2072-666X/13/1/52 |
| work_keys_str_mv | AT wenzezhao applicationorienteddatamigrationtoaccelerateinmemorydatabaseonhybridmemory AT yajuandu applicationorienteddatamigrationtoaccelerateinmemorydatabaseonhybridmemory AT mingzhezhang applicationorienteddatamigrationtoaccelerateinmemorydatabaseonhybridmemory AT mingyangliu applicationorienteddatamigrationtoaccelerateinmemorydatabaseonhybridmemory AT kailunjin applicationorienteddatamigrationtoaccelerateinmemorydatabaseonhybridmemory AT rachataausavarungnirun applicationorienteddatamigrationtoaccelerateinmemorydatabaseonhybridmemory |