Pilot-Job Provisioning through CREAM Computing Elements on the Worldwide LHC Computing Grid

Alexandre F Boyer (1, 2, 3) , David R C Hill (1, 3) , Christophe Haen (2) , Federico Stagni (2)

1 LIMOS - Laboratoire d'Informatique, de Modélisation et d'Optimisation des Systèmes
2 CERN - European Organization for Nuclear Research
3 UCA - Université Clermont Auvergne

The push model, used to manage Computing Grid resources, raises several issues that prevent employing the resources at their full capacity and, thus, limits the Grid throughput. While the push model remains necessary to get access to the resources, this paper aims at addressing some of these issues to make better use of the Worldwide LHC Computing Grid. After a thorough analysis of the DIRAC Workload Management System and its design to assign Pilot-Jobs, we propose different optimizations to improve the submission system and the grid throughput. The obtained results show significant changes in performances and enable the generation of a larger number of Pilot-Jobs to exploit grid resources better.

Domaines: Informatique [cs]; Calcul parallèle, distribué et partagé [cs.DC]; Performance et fiabilité [cs.PF]

Alexandre F Boyer, David R C Hill, Christophe Haen, Federico Stagni. Pilot-Job Provisioning through CREAM Computing Elements on the Worldwide LHC Computing Grid. 34th European Simulation and Modelling Conference (ESM), Oct 2020, Toulouse, France. ⟨hal-03191075⟩