Parallelisation of the Wide-Band Wide-Field Spectral Deconvolution Framework DDFacet on Distributed Memory HPC System

Nicolas Monnier (1, 2) , Erwan Raffin (3) , Cyril Tasse (4) , Jean-François Nezan (5) , Oleg M Smirnov (6)

1 L2S - Laboratoire des signaux et systèmes
2 CEPP - Center for Excellence in Performance Programming [Rennes]
3 CEPP, Center for Excellence in Performance Programming, Atos Bull
4 GEPI - Galaxies, Etoiles, Physique, Instrumentation
5 IETR - Institut d'Electronique et de Télécommunications de Rennes
6 SKA South Africa

The next generation of radio telescopes, such as the Square Kilometer Array (SKA), will need to process an incredible amount of data in real-time. In addition, the sensitivity of SKA will require a new generation of calibration and imaging software to exploit its full potential. The wide-field direction-dependent spectral deconvolution framework, called DDFacet, has already been successfully used in several existing SKA pathfinders like MeerKAT. DDFacet has been developed and optimized for single node HPC systems. DDFacet is a good candidate for being integrated in the SKA computing pipeline and should therefore be run on a massive multi-node HPC system for real-time performances. The objective of this work is to study the potential parallelism of DDFacet on multi-node HPC systems. This paper presents a new parallelization level for multi-node HPC based on frequency domains. Experimental results with a real data set from LOFAR show an optimal parallelisation of the calculations in the frequency domain allowing to generate a sky image more than 4 times faster. This paper analyses the results and draws perspectives for the SKA use case.

Mots clés: SKA; Index Terms-High Performance Computing; Square Kilometer Array; DDFacet; Parallelization; Square Kilome- ter Array

Domaines: Informatique [cs]; Calcul parallèle, distribué et partagé [cs.DC]; Traitement du signal et de l'image [eess.SP]

Nicolas Monnier, Erwan Raffin, Cyril Tasse, Jean-François Nezan, Oleg M Smirnov. Parallelisation of the Wide-Band Wide-Field Spectral Deconvolution Framework DDFacet on Distributed Memory HPC System. 2020. ⟨hal-02611036v2⟩