A Multi-Criteria Experimental Ranking of Distributed SPARQL Evaluators

Damien Graux 1 Louis Jachiet 1 Pierre Genevès 1 Nabil Layaïda 1
1 TYREX - Types and Reasoning for the Web
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : SPARQL is the standard language for querying RDF data. There exists a variety of SPARQL query evaluation systems implementing different architectures for the distribution of data and computations. Differences in architectures coupled with specific optimizations, for e.g. preprocessing and indexing, make these systems incomparable from a purely theoretical perspective. This results in many implementations solving the SPARQL query evaluation problem while exhibiting very different behaviors, not all of them being adapted in any context. We provide a new perspective on distributed SPARQL eval-uators, based on multi-criteria experimental rankings. Our suggested set of 5 features (namely velocity, immediacy, dynamic-ity, parsimony, and resiliency) provides a more comprehensive description of the behaviors of distributed evaluators when compared to traditional runtime performance metrics. We show how these features help in more accurately evaluating to which extent a given system is appropriate for a given use case. For this purpose, we systematically benchmarked a panel of 10 state-of-the-art implementations. We ranked them using a reading grid that helps in pinpointing the advantages and limitations of current technologies for the distributed evaluation of SPARQL queries.
Liste complète des métadonnées

Cited literature [12 references]  Display  Hide  Download

https://hal.inria.fr/hal-01381781
Contributor : Tyrex Equipe <>
Submitted on : Thursday, November 22, 2018 - 10:00:33 AM
Last modification on : Thursday, February 7, 2019 - 4:55:42 PM

File

experiment-analysis.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01381781, version 2

Collections

INRIA | LIG | UGA

Citation

Damien Graux, Louis Jachiet, Pierre Genevès, Nabil Layaïda. A Multi-Criteria Experimental Ranking of Distributed SPARQL Evaluators. Big Data 2018 - IEEE International Conference on Big Data, Dec 2018, Seattle, United States. pp.1-10. ⟨hal-01381781v2⟩

Share

Metrics

Record views

67

Files downloads

145