Discovering and merging related analytic datasets

Abstract : The production of analytic datasets is a significant big data trend and has gone well beyond the scope of traditional IT-governed dataset development. Analytic datasets are now created by data scientists and data analysts using big data frameworks and agile data preparation tools. However, despite the profusion of available datasets, it remains quite difficult for a data analyst to start from a dataset at hand and customize it with additional attributes coming from other existing datasets. This article describes a model and algorithms that exploit automatically extracted and user-defined semantic relationships for extending analytic datasets with new atomic or aggregated attribute values. Our framework is implemented as a REST service in the SAP HANA and includes a careful analysis and practical solutions for several complex data quality issues.
Document type :
Journal articles
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02459098
Contributor : Bernd Amann <>
Submitted on : Wednesday, January 29, 2020 - 10:50:18 AM
Last modification on : Friday, January 31, 2020 - 1:34:24 AM

Identifiers

Citation

Rutian Liu, Eric Simon, Bernd Amann, Stéphane Gançarski. Discovering and merging related analytic datasets. Information Systems, Elsevier, In press, 91, pp.101495. ⟨10.1016/j.is.2020.101495⟩. ⟨hal-02459098⟩

Share

Metrics

Record views

16