MTCB: A Multi-Tenant Customizable database Benchmark

Wim van der Zijden, Djoerd Hiemstra, Maurice van Keulen

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

We argue that there is a need for Multi-Tenant Customizable OLTP systems. Such systems need a Multi-Tenant Customizable Database (MTC-DB) as a backing. To stimulate the development of such databases, we propose the benchmark MTCB. Benchmarks for OLTP exist and multi-tenant benchmarks exist, but no MTC-DB benchmark exists that accounts for customizability. We formulate seven requirements for the benchmark: realistic, unambiguous, comparable, correct, scalable, simple and independent. It focuses on performance aspects and produces nine metrics: Aulbach compliance, size on disk, tenants created, types created, attributes created, transaction data type instances created per minute, transaction data type instances loaded by ID per minute, conjunctive searches per minute and disjunctive searches per minute. We present a specification and an example implementation in Java 8, which can be accessed on this public repository: https://bitbucket.org/actfact/mtcdb-benchmark. In the same repository a naive implementation can be found of an MTC-DB where each tenant has its own schema. We believe that this benchmark is a valuable contribution to the community of MTC-DB developers, because it provides objective comparability as well as a precise definition of the concept of MTC-DB.
LanguageEnglish
Title of host publicationICME 2017
Subtitle of host publicationProceedings of the 9th International Conference on Information Management and Engineering
PublisherAssociation for Computing Machinery (ACM)
Pages17-23
ISBN (Electronic)978-1-4503-5337-3
DOIs
Publication statusPublished - Oct 2017

Fingerprint

Benchmarking
Databases
Compliance

Keywords

  • Multi-Tenant Customizable
  • Multi-level customizability
  • OLTP
  • Database
  • Benchmark

Cite this

van der Zijden, W., Hiemstra, D., & van Keulen, M. (2017). MTCB: A Multi-Tenant Customizable database Benchmark. In ICME 2017: Proceedings of the 9th International Conference on Information Management and Engineering (pp. 17-23). Association for Computing Machinery (ACM). https://doi.org/10.1145/3149572.3149585
van der Zijden, Wim ; Hiemstra, Djoerd ; van Keulen, Maurice . / MTCB: A Multi-Tenant Customizable database Benchmark. ICME 2017: Proceedings of the 9th International Conference on Information Management and Engineering . Association for Computing Machinery (ACM), 2017. pp. 17-23
@inproceedings{c5f6d83ec0e249f7b5939106b262a711,
title = "MTCB: A Multi-Tenant Customizable database Benchmark",
abstract = "We argue that there is a need for Multi-Tenant Customizable OLTP systems. Such systems need a Multi-Tenant Customizable Database (MTC-DB) as a backing. To stimulate the development of such databases, we propose the benchmark MTCB. Benchmarks for OLTP exist and multi-tenant benchmarks exist, but no MTC-DB benchmark exists that accounts for customizability. We formulate seven requirements for the benchmark: realistic, unambiguous, comparable, correct, scalable, simple and independent. It focuses on performance aspects and produces nine metrics: Aulbach compliance, size on disk, tenants created, types created, attributes created, transaction data type instances created per minute, transaction data type instances loaded by ID per minute, conjunctive searches per minute and disjunctive searches per minute. We present a specification and an example implementation in Java 8, which can be accessed on this public repository: https://bitbucket.org/actfact/mtcdb-benchmark. In the same repository a naive implementation can be found of an MTC-DB where each tenant has its own schema. We believe that this benchmark is a valuable contribution to the community of MTC-DB developers, because it provides objective comparability as well as a precise definition of the concept of MTC-DB.",
keywords = "Multi-Tenant Customizable, Multi-level customizability, OLTP, Database, Benchmark",
author = "{van der Zijden}, Wim and Djoerd Hiemstra and {van Keulen}, Maurice",
year = "2017",
month = "10",
doi = "10.1145/3149572.3149585",
language = "English",
pages = "17--23",
booktitle = "ICME 2017",
publisher = "Association for Computing Machinery (ACM)",
address = "United States",

}

van der Zijden, W, Hiemstra, D & van Keulen, M 2017, MTCB: A Multi-Tenant Customizable database Benchmark. in ICME 2017: Proceedings of the 9th International Conference on Information Management and Engineering . Association for Computing Machinery (ACM), pp. 17-23. https://doi.org/10.1145/3149572.3149585

MTCB: A Multi-Tenant Customizable database Benchmark. / van der Zijden, Wim; Hiemstra, Djoerd ; van Keulen, Maurice .

ICME 2017: Proceedings of the 9th International Conference on Information Management and Engineering . Association for Computing Machinery (ACM), 2017. p. 17-23.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - MTCB: A Multi-Tenant Customizable database Benchmark

AU - van der Zijden, Wim

AU - Hiemstra, Djoerd

AU - van Keulen, Maurice

PY - 2017/10

Y1 - 2017/10

N2 - We argue that there is a need for Multi-Tenant Customizable OLTP systems. Such systems need a Multi-Tenant Customizable Database (MTC-DB) as a backing. To stimulate the development of such databases, we propose the benchmark MTCB. Benchmarks for OLTP exist and multi-tenant benchmarks exist, but no MTC-DB benchmark exists that accounts for customizability. We formulate seven requirements for the benchmark: realistic, unambiguous, comparable, correct, scalable, simple and independent. It focuses on performance aspects and produces nine metrics: Aulbach compliance, size on disk, tenants created, types created, attributes created, transaction data type instances created per minute, transaction data type instances loaded by ID per minute, conjunctive searches per minute and disjunctive searches per minute. We present a specification and an example implementation in Java 8, which can be accessed on this public repository: https://bitbucket.org/actfact/mtcdb-benchmark. In the same repository a naive implementation can be found of an MTC-DB where each tenant has its own schema. We believe that this benchmark is a valuable contribution to the community of MTC-DB developers, because it provides objective comparability as well as a precise definition of the concept of MTC-DB.

AB - We argue that there is a need for Multi-Tenant Customizable OLTP systems. Such systems need a Multi-Tenant Customizable Database (MTC-DB) as a backing. To stimulate the development of such databases, we propose the benchmark MTCB. Benchmarks for OLTP exist and multi-tenant benchmarks exist, but no MTC-DB benchmark exists that accounts for customizability. We formulate seven requirements for the benchmark: realistic, unambiguous, comparable, correct, scalable, simple and independent. It focuses on performance aspects and produces nine metrics: Aulbach compliance, size on disk, tenants created, types created, attributes created, transaction data type instances created per minute, transaction data type instances loaded by ID per minute, conjunctive searches per minute and disjunctive searches per minute. We present a specification and an example implementation in Java 8, which can be accessed on this public repository: https://bitbucket.org/actfact/mtcdb-benchmark. In the same repository a naive implementation can be found of an MTC-DB where each tenant has its own schema. We believe that this benchmark is a valuable contribution to the community of MTC-DB developers, because it provides objective comparability as well as a precise definition of the concept of MTC-DB.

KW - Multi-Tenant Customizable

KW - Multi-level customizability

KW - OLTP

KW - Database

KW - Benchmark

U2 - 10.1145/3149572.3149585

DO - 10.1145/3149572.3149585

M3 - Conference contribution

SP - 17

EP - 23

BT - ICME 2017

PB - Association for Computing Machinery (ACM)

ER -

van der Zijden W, Hiemstra D, van Keulen M. MTCB: A Multi-Tenant Customizable database Benchmark. In ICME 2017: Proceedings of the 9th International Conference on Information Management and Engineering . Association for Computing Machinery (ACM). 2017. p. 17-23 https://doi.org/10.1145/3149572.3149585