Big Data Management in the Cloud: Evolution or Crossroad?

Abdelkader Hameurlain (1) , Franck Morvan (1)

1 IRIT-PYRAMIDE - Optimisation Dynamique de Requêtes Réparties à grande échelle

In this paper, we try to provide a synthetic and comprehensive state of the art concerning big data management in cloud environments. In this perspective, data management based on parallel and cloud (e.g. MapReduce) systems are overviewed, and compared by relying on meeting software requirements (e.g. data independence, software reuse), high performance, scalability, elasticity, and data availability. With respect to proposed cloud systems, we discuss evolution of their data manipulation languages and we try to learn some lessons should be exploited to ensure the viability of the next generation of large-scale data management systems for big data applications.

Mots clés: Data partitioning; Big data management; Elasticity; Spark; Query processing and optimization; Parallel Relational Database Systems; High performance; Scalability; Cloud systems; Hadoop; Mapreduce

Domaines: Théorie de l'information [cs.IT]; Recherche d'information [cs.IR]

Abdelkader Hameurlain, Franck Morvan. Big Data Management in the Cloud: Evolution or Crossroad?. Beyond Databases, Architectures and Structures (BDAS 2016), May 2016, Ustron, Poland. pp. 23-38. ⟨hal-01485006⟩