A Content-Driven ETL Processes for Open Data (ADBIS 2014)

Alain Berro (1, 2) , Imen Megdiche (3, 4) , Olivier Teste (3, 5)

1 IRIT-SEPIA - Système d’exploitation, systèmes répartis, de l’intergiciel à l’architecture
2 UT Capitole - Université Toulouse Capitole
3 IRIT-SIG - Systèmes d’Informations Généralisées
4 INUC - Institut national universitaire Champollion [Albi]
5 UT2J - Université Toulouse - Jean Jaurès

The emergent statistical Open Data (OD) seems very promising to generate various analysis scenarios for decision-making systems. Nevertheless, OD has problematic characteristics such as semantic and structural heterogeneousness, lack of schemas, autonomy and dispersion. These characteristics shakes the traditional Extract-Transform-Load (ETL) processes since these latter generally deal with well structured schemas. We propose in this paper a content-driven ETL processes which automates ''as far as possible'' the extraction phase based only on the content of flat Open Data sources. Our processes rely on data annotations and data mining techniques to discover hierarchical relationships. Processed data are then transformed into instance-schema graphs to facilitate the structural data integration and the definition of the multidimensional schemas of the data warehouse.

Mots clés: Open Data; ETL; Graphs; Self-Service; BI; Hierarchical classification; Data warehouse

Domaines: Intelligence artificielle [cs.AI]

Alain Berro, Imen Megdiche, Olivier Teste. A Content-Driven ETL Processes for Open Data (ADBIS 2014). Bassiliades, Nick; Ivanovic, Mirjana; Kon-Popovska, Margita; Palpanas, Themis; Trajcevski, Goce. New Trends in Database and Information Systems II : Selected papers of the 18th East European Conference on Advances in Databases and Information Systems and Associated Satellite Events, ADBIS 2014 Ohrid, Macedonia, September 7-10, 2014 - Proceedings II, 312 (II), Springer-Verlag, pp.29--40, 2015, Advances in Intelligent Systems and Computing book series (AISC), 978-3-319-10518-5. ⟨10.1007/978-3-319-10518-5_3⟩. ⟨hal-03190204⟩