On the Evaluation of RDF Distribution Algorithms Implemented over Apache Spark

Abstract : Querying very large RDF data sets in an efficient and scalable manner requires parallel query plans combined with appropriate data distribution strategies. Several innovative solutions have recently been proposed for optimizing data distribution with or without predefined query workloads. This paper presents an in-depth analysis and experimental comparison of five representative RDF data distribution approaches. For achieving fair experimental results, we are using Apache Spark as a common parallel computing framework by rewriting the concerned algorithms using the Spark API. Spark provides guarantees in terms of fault tolerance, high availability and scalability which are essential in such systems. Our different implementations aim to highlight the fundamental implementation-independent characteristics of each approach in terms of data preparation, load balancing, data replication and to some extent to query answering cost and performance. The presented measures are obtained by testing each system on one synthetic and one real-world data set over query workloads with differing characteristics and different partitioning constraints.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01214902
Contributor : Lip6 Publications <>
Submitted on : Tuesday, October 13, 2015 - 11:58:12 AM
Last modification on : Friday, March 22, 2019 - 1:39:04 AM

Links full text

Identifiers

  • HAL Id : hal-01214902, version 1
  • ARXIV : 1507.02321

Citation

Olivier Curé, Hubert Naacke, Mohamed-Amine Baazizi, Bernd Amann. On the Evaluation of RDF Distribution Algorithms Implemented over Apache Spark. The 11th International Workshop on Scalable Semantic Web Knowledge Base Systems, Oct 2015, Bethlehem, Pennsylvania, United States. pp.16-31. ⟨hal-01214902⟩

Share

Metrics

Record views

277