Metadata Management for Data Lakes

Franck Ravat (1, 2) , Yan Zhao (1)

1 IRIT-SIG - Systèmes d’Informations Généralisées
2 UT Capitole - Université Toulouse Capitole

To prevent data lakes from being invisible and inaccessible to users, an efficient metadata management system is necessary. In this paper, we propose a such system based on a generic and extensible classification of metadata. A metadata conceptual schema which considers different types (structured, semi-structured and unstructured) of raw or processed data is presented. This schema is implemented in two DBMSs (relational and graph) to validate our proposal.

Mots clés: Metadata classification; Metadata management; Data lake

Domaines: Base de données [cs.DB]

Franck Ravat, Yan Zhao. Metadata Management for Data Lakes. 23rd East-European Conference on Advances in Databases and Information Systems (ADBIS 2019), Sep 2019, Bled, Slovenia. pp.37-44. ⟨hal-02397467⟩