Parallel Processing of Group-By Join Queries on Shared Nothing Machines

Mohamad Al Hajj Hassan (1) , Mostafa Bamha (1)

1 LIFO - Laboratoire d'Informatique Fondamentale d'Orléans

SQL queries involving join and group-by operations are frequently used in many decision support applications. In these applications, the size of the input relations is usually very large, so the parallelization of these queries is highly recommended in order to obtain a desirable response time. The main drawbacks of the presented parallel algorithms that treat this kind of queries are that they are very sensitive to data skew and involve expansive communication and Input/Output costs in the evaluation of the join operation. In this paper, we present an algorithm that minimizes the communication cost by performing the group-by operation before redistribution where only tuples that will be present in the join result are redistributed. In addition, it evaluates the query without the need of materializing the result of the join operation and thus reducing the Input/Output cost of join intermediate results. The performance of this algorithm is analyzed using the scalable and portable BSP (Bulk Synchronous Parallel) cost model which predicts a near-linear speed-up even for highly skewed data.

Keywords: PDBMS; Parallel joins; Data skew; Join product skew; GroupBy-Join queries; BSP cost model

Domains: Computer science

Mohamad Al Hajj Hassan, Mostafa Bamha. Parallel Processing of Group-By Join Queries on Shared Nothing Machines. Joaquim Filipe, Boris Shishkov and Markus Helfert. Software and Data Technologies, Extended and revised -ICSOFT'2006 Best papers- Book, Springer Berlin Heidelberg, pp.230-241, 2008, Communications in Computer and Information Science;, ⟨10.1007/978-3-540-70621-2_19⟩. ⟨hal-00460664⟩