Benchmarking Dependability of MapReduce Systems

Amit Sangroya 1 Damián Serrano 1 Sara Bouchenak 1
1 SARDES - System architecture for reflective distributed computing environments
Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : MapReduce is a popular programming model for distributed data processing. Extensive research has been conducted on the reliability of MapReduce, ranging from adaptive and on-demand fault-tolerance to new fault-tolerance models. However, realistic benchmarks are still missing to analyze and compare the effectiveness of these proposals. To date, most MapReduce fault-tolerance solutions have been evaluated using microbenchmarks in an ad-hoc and overly simplified setting,which may not be representative of real-world applications. This paper presents MRBS, a comprehensive benchmark suite for evaluating the dependability of MapReduce systems. MRBS includes five benchmarks covering several application domains and a wide range of execution scenarios such as data-intensive vs. compute-intensive applications, or batch applications vs. online interactive applications. MRBS allows to inject various types of faults at different rates. It also considers different application workloads and dataloads, and produces extensive reliability, availability and performance statistics. We illustrate the use of MRBS with Hadoop clusters running on Amazon EC2, and on a private cloud.
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01472165
Contributor : Grégory Mounié <>
Submitted on : Monday, February 20, 2017 - 3:45:11 PM
Last modification on : Thursday, February 7, 2019 - 5:17:00 PM
Long-term archiving on : Sunday, May 21, 2017 - 2:59:41 PM

File

RR-LIG-027.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01472165, version 1

Collections

Citation

Amit Sangroya, Damián Serrano, Sara Bouchenak. Benchmarking Dependability of MapReduce Systems. [Research Report] RR-LIG-027, LIG. 2012. ⟨hal-01472165⟩

Share

Metrics

Record views

196

Files downloads

307