DIRAC pilot framework and the DIRAC Workload Management System

Abstract : DIRAC, the LHCb community Grid solution, has pioneered the use of pilot jobs in the Grid. Pilot Jobs provide a homogeneous interface to an heterogeneous set of computing resources. At the same time, Pilot Jobs allow to delay the scheduling decision to the last moment, thus taking into account the precise running conditions at the resource and last moment requests to the system. The DIRAC Workload Management System provides one single scheduling mechanism for jobs with very different profiles. To achieve an overall optimisation, it organizes pending jobs in task queues, both for individual users and production activities. Task queues are created with jobs having similar requirements. Following the VO policy a priority is assigned to each task queue. Pilot submission and subsequent job matching are based on these priorities following a statistical approach.
Complete list of metadatas

http://hal.in2p3.fr/in2p3-00737583
Contributor : Danielle Cristofol <>
Submitted on : Tuesday, October 2, 2012 - 11:47:36 AM
Last modification on : Thursday, January 18, 2018 - 2:21:01 AM

Links full text

Identifiers

Collections

Citation

A. Casajus, R. Graciani, S. Paterson, A. Tsaregorodtsev. DIRAC pilot framework and the DIRAC Workload Management System. 17th International Conference on Computing in High Energy and Nuclear Physics (CHEP09), Mar 2009, Prague, Czech Republic. pp.062049, ⟨10.1088/1742-6596/219/6/062049⟩. ⟨in2p3-00737583⟩

Share

Metrics

Record views

248