Benchmarking HTAP databases for performance isolation and real-time analytics

Hybrid Transactional/Analytical Processing (HTAP) databases are designed to execute real-time analytics and provide performance isolation for online transactions and analytical queries. Real-time analytics emphasize analyzing the fresh data generated by online transactions. And performance isolation...

Full description

Bibliographic Details
Main Authors: Guoxin Kang, Simin Chen, Hongxiao Li
Format: Article
Language:English
Published: KeAi Communications Co. Ltd. 2023-06-01
Series:BenchCouncil Transactions on Benchmarks, Standards and Evaluations
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S277248592300039X
_version_ 1797769805498941440
author Guoxin Kang
Simin Chen
Hongxiao Li
author_facet Guoxin Kang
Simin Chen
Hongxiao Li
author_sort Guoxin Kang
collection DOAJ
description Hybrid Transactional/Analytical Processing (HTAP) databases are designed to execute real-time analytics and provide performance isolation for online transactions and analytical queries. Real-time analytics emphasize analyzing the fresh data generated by online transactions. And performance isolation depicts the performance interference between concurrently executing online transactions and analytical queries. However, HTAP databases are extreme lack micro-benchmarks to accurately measure data freshness. Despite the abundance of HTAP databases and benchmarks, there needs to be more thorough research on the performance isolation and real-time analytics capabilities of HTAP databases. This paper focuses on the critical designs of mainstream HTAP databases and the state-of-the-art and state-of-the-practice HTAP benchmarks. First, we systematically introduce the advanced technologies adopted by HTAP databases for real-time analytics and performance isolation capabilities. Then, we summarize the pros and cons of the state-of-the-art and state-of-the-practice HTAP benchmarks. Next, we design and implement a micro-benchmark for HTAP databases, which can precisely control the rate of fresh data generation and the granularity of fresh data access. Finally, we devise experiments to evaluate the performance isolation and real-time analytics capabilities of the state-of-the-art HTAP database. In our continued pursuit of transparency and community collaboration, we will soon make available our comprehensive specifications, meticulously crafted source code, and significant results for public access at https://www.benchcouncil.org/mOLxPBench.
first_indexed 2024-03-12T21:14:19Z
format Article
id doaj.art-cfded86d6a54414f8da4f7598139a551
institution Directory Open Access Journal
issn 2772-4859
language English
last_indexed 2024-03-12T21:14:19Z
publishDate 2023-06-01
publisher KeAi Communications Co. Ltd.
record_format Article
series BenchCouncil Transactions on Benchmarks, Standards and Evaluations
spelling doaj.art-cfded86d6a54414f8da4f7598139a5512023-07-30T04:23:09ZengKeAi Communications Co. Ltd.BenchCouncil Transactions on Benchmarks, Standards and Evaluations2772-48592023-06-0132100122Benchmarking HTAP databases for performance isolation and real-time analyticsGuoxin Kang0Simin Chen1Hongxiao Li2Corresponding author.; Institute of Computing Technology Chinese Academy of Sciences, China; University of Chinese Academy of Sciences, ChinaInstitute of Computing Technology Chinese Academy of Sciences, China; University of Chinese Academy of Sciences, ChinaInstitute of Computing Technology Chinese Academy of Sciences, China; University of Chinese Academy of Sciences, ChinaHybrid Transactional/Analytical Processing (HTAP) databases are designed to execute real-time analytics and provide performance isolation for online transactions and analytical queries. Real-time analytics emphasize analyzing the fresh data generated by online transactions. And performance isolation depicts the performance interference between concurrently executing online transactions and analytical queries. However, HTAP databases are extreme lack micro-benchmarks to accurately measure data freshness. Despite the abundance of HTAP databases and benchmarks, there needs to be more thorough research on the performance isolation and real-time analytics capabilities of HTAP databases. This paper focuses on the critical designs of mainstream HTAP databases and the state-of-the-art and state-of-the-practice HTAP benchmarks. First, we systematically introduce the advanced technologies adopted by HTAP databases for real-time analytics and performance isolation capabilities. Then, we summarize the pros and cons of the state-of-the-art and state-of-the-practice HTAP benchmarks. Next, we design and implement a micro-benchmark for HTAP databases, which can precisely control the rate of fresh data generation and the granularity of fresh data access. Finally, we devise experiments to evaluate the performance isolation and real-time analytics capabilities of the state-of-the-art HTAP database. In our continued pursuit of transparency and community collaboration, we will soon make available our comprehensive specifications, meticulously crafted source code, and significant results for public access at https://www.benchcouncil.org/mOLxPBench.http://www.sciencedirect.com/science/article/pii/S277248592300039XHTAP databasesBenchmarkPerformance isolationReal-time analytics
spellingShingle Guoxin Kang
Simin Chen
Hongxiao Li
Benchmarking HTAP databases for performance isolation and real-time analytics
BenchCouncil Transactions on Benchmarks, Standards and Evaluations
HTAP databases
Benchmark
Performance isolation
Real-time analytics
title Benchmarking HTAP databases for performance isolation and real-time analytics
title_full Benchmarking HTAP databases for performance isolation and real-time analytics
title_fullStr Benchmarking HTAP databases for performance isolation and real-time analytics
title_full_unstemmed Benchmarking HTAP databases for performance isolation and real-time analytics
title_short Benchmarking HTAP databases for performance isolation and real-time analytics
title_sort benchmarking htap databases for performance isolation and real time analytics
topic HTAP databases
Benchmark
Performance isolation
Real-time analytics
url http://www.sciencedirect.com/science/article/pii/S277248592300039X
work_keys_str_mv AT guoxinkang benchmarkinghtapdatabasesforperformanceisolationandrealtimeanalytics
AT siminchen benchmarkinghtapdatabasesforperformanceisolationandrealtimeanalytics
AT hongxiaoli benchmarkinghtapdatabasesforperformanceisolationandrealtimeanalytics