Packed-Memory Quadtree: a cache-oblivious data structure for visual exploration of streaming spatiotemporal big data

Julio Toss 1, 2 Cicero A. L. Pahins 2 Bruno Raffin 1 João Luiz Dihl Comba 2
1 DATAMOVE - Data Aware Large Scale Computing
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : The visual analysis of large multidimensional spatiotem-poral datasets poses challenging questions regarding storage requirements and query performance. Several data structures have recently been proposed to address these problems that rely on indexes that pre-compute different aggregations from a known-a-priori dataset. Consider now the problem of handling streaming datasets, in which data arrive as one or more continuous data streams. Such datasets introduce challenges to the data structure, which now has to support dynamic updates (insertion-s/deletions) and rebalancing operations to perform self-reorganizations. In this work, we present the Packed-Memory Quadtree (PMQ), a novel data structure designed to support visual exploration of streaming spatiotemporal datasets. PMQ is cache-oblivious to perform well under different cache configurations. We store streaming data in an internal index that keeps a spatiotemporal ordering over the data following a quadtree representation, with support for real-time insertions and deletions. We validate our data structure under different dynamic scenarios and compare to competing strategies. We demonstrate how PMQ could be used to answer different types of visual spatiotemporal range queries of streaming datasets.
Type de document :
Article dans une revue
Computers and Graphics, Elsevier, 2018, 76, pp.117-128. 〈10.1016/j.cag.2018.09.005〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01876579
Contributeur : Bruno Raffin <>
Soumis le : mardi 18 septembre 2018 - 15:27:58
Dernière modification le : jeudi 11 octobre 2018 - 08:48:05

Identifiants

Collections

Citation

Julio Toss, Cicero A. L. Pahins, Bruno Raffin, João Luiz Dihl Comba. Packed-Memory Quadtree: a cache-oblivious data structure for visual exploration of streaming spatiotemporal big data. Computers and Graphics, Elsevier, 2018, 76, pp.117-128. 〈10.1016/j.cag.2018.09.005〉. 〈hal-01876579〉

Partager

Métriques

Consultations de la notice

393

Téléchargements de fichiers

129