Enriching Geolocalized Dataset with POIs Descriptions at Large Scale

Ibrahima Gueye (1) , Hubert Naacke (2) , Stéphane Gançarski (2)

1 Ecole polytechnique de Thiès
2 BD - Bases de Données

We present an efficient method to enrich a geolocalized dataset with contextual description about Points of Interest (POI). We implemented our solution using two large scale datasets: YFCC and Geonames. A practical problem we have encountered is the size of the manipulated data. Actually, the YFCC geolocalized dataset accounts for 45 million entries that we propose to cross with 12 millions of Geonames POIs. We show that using the Apache Spark cluster computing platform and the GeoSpark spatial join library as-is lead to inefficient computation because of the important bias in the data. We propose a method to distribute the data non uniformly according to the data bias, which greatly improves the spatial join performance. Moreover, we propose a method to select among a set of close POIs, those which are the most relevant with the YFCC entries. The resulting enriched dataset will be made publicly available and should contribute to better validate future works on large scale POI recommendation.

Mots clés: YFCC large scale dataset; Distributed query processing; Spatial join; Apache Spark; POI recommendation

Domaines: Informatique [cs]

Ibrahima Gueye, Hubert Naacke, Stéphane Gançarski. Enriching Geolocalized Dataset with POIs Descriptions at Large Scale. Innovations and Interdisciplinary Solutions for Underserved Areas, Mar 2020, Nairobi, Kenya. pp.264-273, ⟨10.1007/978-3-030-51051-0_19⟩. ⟨hal-03990440⟩