Data-Centric Benchmarking

Jérôme Darmont (1)

1 ERIC - Entrepôts, Représentation et Ingénierie des Connaissances

In data management, both system designers and users casually resort to performance evaluation. Performance evaluation by experimentation on a real system is generally referred to as benchmarking. The aim of this chapter is to present an overview of the major past and present state-of-the-art data-centric benchmarks. This review includes the TPC standard benchmarks, but also alternative or more specialized benchmarks. Surveyed benchmarks are categorized into three families: transaction benchmarks aimed at On-Line Transaction Processing (OLTP), decision-support benchmarks aimed at On-Line Analysis Processing (OLAP) and big data benchmarks. Issues, tradeoffs and future trends in data-centric benchmarking are also discussed.

Mots clés: Analytics; Benchmark; Big Data; Database; Data Warehouse; ETL; Metrics; OLAP; OLTP; Performance; TPC; Workload

Domaines: Base de données [cs.DB]

Jérôme Darmont. Data-Centric Benchmarking. Mehdi Khosrow-Pour. Encyclopedia of Information Science and Technology, Fourth Edition, IGI Global, pp.1772-1782, 2017, 9781522522553. ⟨10.4018/978-1-5225-2255-3.ch154⟩. ⟨hal-01547328⟩