A Methodology to Build Decision Analysis Tools Applied to Distributed Reinforcement Learning - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

A Methodology to Build Decision Analysis Tools Applied to Distributed Reinforcement Learning

Loïc Cudennec
  • Fonction : Auteur
  • PersonId : 1081389
Gabriel Antoniu

Résumé

As Artificial Intelligence-based applications become more and more complex, speeding up the learning phase (which is typically computation-intensive) becomes more and more necessary. Distributed machine learning (ML) appears adequate to address this problem. Unfortunately, ML also brings new development frameworks, methodologies and high-level programming languages that do not fit to the regular high-performance computing design flow. This paper introduces a methodology to build a decision making tool that allows ML experts to arbitrate between different frameworks and deployment configurations, in order to fulfill project objectives such as the accuracy of the resulting model, the computing speed or the energy consumption of the learning computation. The proposed methodology is applied to an industrial-grade case study in which reinforcement learning is used to train an autonomous steering model for a cargo airdrop system. Results are presented within a Pareto front that lets ML experts choose an appropriate solution, a framework and a deployment configuration, based on the current operational situation. While the proposed approach can effortlessly be applied to other machine learning problems, as for many decision making systems, the selected solutions involve a trade-off between several antagonist evaluation criteria and require experts from different domains to pick the most efficient solution from the short list. Nevertheless, this methodology speeds up the development process by clearly discarding, or, on the contrary, including combinations of frameworks and configurations, which has a significant impact for time and budget-constrained projects.
Fichier principal
Vignette du fichier
A Methodology to Build Decision Analysis Tools.pdf (1.39 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03613558 , version 1 (18-03-2022)

Licence

Paternité

Identifiants

  • HAL Id : hal-03613558 , version 1

Citer

Cédric Prigent, Loïc Cudennec, Alexandru Costan, Gabriel Antoniu. A Methodology to Build Decision Analysis Tools Applied to Distributed Reinforcement Learning. ScaDL 2022 - Scalable Deep Learning over Parallel and Distributed Infrastructures - An IPDPS Workshop, Jun 2022, Lyon / Virtual, France. pp.1-10. ⟨hal-03613558⟩
237 Consultations
128 Téléchargements

Partager

Gmail Facebook X LinkedIn More