BIGhybrid - A Toolkit for Simulating MapReduce on Hybrid Infrastructures - Archive ouverte HAL Accéder directement au contenu
Rapport Année : 2014

BIGhybrid - A Toolkit for Simulating MapReduce on Hybrid Infrastructures

Résumé

Cloud computing has increasingly been used as a platform for running large business and data processing applications. Although clouds have become highly popular, when it comes to data processing, the cost of usage is not negligible. Conversely, Desktop Grids, have been used by a plethora of projects, taking advantage of the high number of resources provided for free by volunteers. Merging cloud computing and desktop grids into hybrid infrastructure can provide a feasible low-cost solution for big data analysis. Although frameworks like MapReduce have been conceived to exploit commodity hardware, their use on hybrid infrastructure poses some challenges due to large resource heterogeneity and high churn rate. This study introduces BIGhybrid a toolkit to simulate MapReduce on hybrid environments. The main goal is to provide a framework for developers and system designers to address the issues of hybrid MapReduce. In this paper, we describe the framework which simulates the assembly of two existing middleware: BitDew- MapReduce for Desktop Grids and Hadoop-BlobSeer for Cloud Computing. Experimental results included in this work demonstrate the feasibility of our approach.
Fichier principal
Vignette du fichier
Bighybrid.pdf (438.59 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01062709 , version 1 (13-10-2014)

Identifiants

  • HAL Id : hal-01062709 , version 1

Citer

Julio Cesar Santos dos Anjos, Gilles Fedak, Claudio Geyer. BIGhybrid - A Toolkit for Simulating MapReduce on Hybrid Infrastructures. 2014. ⟨hal-01062709v1⟩
327 Consultations
389 Téléchargements

Partager

Gmail Facebook X LinkedIn More