Are current benchmarks adequate to evaluate distributed transactional databases?
With the rapid development of distributed transactional databases in recent years, there is an urgent need for fair performance evaluation and comparison. Though there are various open-source benchmarks built for databases, it is lack of a comprehensive study about the applicability for distributed...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
KeAi Communications Co. Ltd.
2022-03-01
|
| Series: | BenchCouncil Transactions on Benchmarks, Standards and Evaluations |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2772485922000187 |
| _version_ | 1797980290409299968 |
|---|---|
| author | Luyi Qu Qingshuai Wang Ting Chen Keqiang Li Rong Zhang Xuan Zhou Quanqing Xu Zhifeng Yang Chuanhui Yang Weining Qian Aoying Zhou |
| author_facet | Luyi Qu Qingshuai Wang Ting Chen Keqiang Li Rong Zhang Xuan Zhou Quanqing Xu Zhifeng Yang Chuanhui Yang Weining Qian Aoying Zhou |
| author_sort | Luyi Qu |
| collection | DOAJ |
| description | With the rapid development of distributed transactional databases in recent years, there is an urgent need for fair performance evaluation and comparison. Though there are various open-source benchmarks built for databases, it is lack of a comprehensive study about the applicability for distributed transactional databases. This paper presents a review of the state-of-art benchmarks with respect to distributed transactional databases. We first summarize the representative architectures of distributed transactional databases and then provide an overview about the chock points in distributed transactional databases. Then, we classify the classic transactional benchmarks based on their characteristics and design purposes. Finally, we review these benchmarks from schema and data definition, workload generation, and evaluation and metrics to check whether they are still applicable to distributed transactional databases with respect to the chock points. This paper exposes a potential research direction to motivate future benchmark designs in the area of distributed transactional databases. |
| first_indexed | 2024-04-11T05:52:24Z |
| format | Article |
| id | doaj.art-985a6bf9f6414182bb890c05a45d4ddf |
| institution | Directory Open Access Journal |
| issn | 2772-4859 |
| language | English |
| last_indexed | 2024-04-11T05:52:24Z |
| publishDate | 2022-03-01 |
| publisher | KeAi Communications Co. Ltd. |
| record_format | Article |
| series | BenchCouncil Transactions on Benchmarks, Standards and Evaluations |
| spelling | doaj.art-985a6bf9f6414182bb890c05a45d4ddf2022-12-22T04:42:01ZengKeAi Communications Co. Ltd.BenchCouncil Transactions on Benchmarks, Standards and Evaluations2772-48592022-03-0121100031Are current benchmarks adequate to evaluate distributed transactional databases?Luyi Qu0Qingshuai Wang1Ting Chen2Keqiang Li3Rong Zhang4Xuan Zhou5Quanqing Xu6Zhifeng Yang7Chuanhui Yang8Weining Qian9Aoying Zhou10East China Normal University, ChinaEast China Normal University, ChinaEast China Normal University, ChinaEast China Normal University, ChinaEast China Normal University, China; Corresponding author.East China Normal University, ChinaOceanBase, ChinaOceanBase, ChinaOceanBase, ChinaEast China Normal University, ChinaEast China Normal University, ChinaWith the rapid development of distributed transactional databases in recent years, there is an urgent need for fair performance evaluation and comparison. Though there are various open-source benchmarks built for databases, it is lack of a comprehensive study about the applicability for distributed transactional databases. This paper presents a review of the state-of-art benchmarks with respect to distributed transactional databases. We first summarize the representative architectures of distributed transactional databases and then provide an overview about the chock points in distributed transactional databases. Then, we classify the classic transactional benchmarks based on their characteristics and design purposes. Finally, we review these benchmarks from schema and data definition, workload generation, and evaluation and metrics to check whether they are still applicable to distributed transactional databases with respect to the chock points. This paper exposes a potential research direction to motivate future benchmark designs in the area of distributed transactional databases.http://www.sciencedirect.com/science/article/pii/S2772485922000187Distributed transactional databasesBenchmarksWorkload |
| spellingShingle | Luyi Qu Qingshuai Wang Ting Chen Keqiang Li Rong Zhang Xuan Zhou Quanqing Xu Zhifeng Yang Chuanhui Yang Weining Qian Aoying Zhou Are current benchmarks adequate to evaluate distributed transactional databases? BenchCouncil Transactions on Benchmarks, Standards and Evaluations Distributed transactional databases Benchmarks Workload |
| title | Are current benchmarks adequate to evaluate distributed transactional databases? |
| title_full | Are current benchmarks adequate to evaluate distributed transactional databases? |
| title_fullStr | Are current benchmarks adequate to evaluate distributed transactional databases? |
| title_full_unstemmed | Are current benchmarks adequate to evaluate distributed transactional databases? |
| title_short | Are current benchmarks adequate to evaluate distributed transactional databases? |
| title_sort | are current benchmarks adequate to evaluate distributed transactional databases |
| topic | Distributed transactional databases Benchmarks Workload |
| url | http://www.sciencedirect.com/science/article/pii/S2772485922000187 |
| work_keys_str_mv | AT luyiqu arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT qingshuaiwang arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT tingchen arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT keqiangli arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT rongzhang arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT xuanzhou arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT quanqingxu arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT zhifengyang arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT chuanhuiyang arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT weiningqian arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases AT aoyingzhou arecurrentbenchmarksadequatetoevaluatedistributedtransactionaldatabases |