Solving efficiently Decentralized MDPs with temporal and resource constraints - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Autonomous Agents and Multi-Agent Systems Année : 2011

Solving efficiently Decentralized MDPs with temporal and resource constraints

Aurélie Beynier
Abdel-Illah Mouaddib
  • Fonction : Auteur
  • PersonId : 774873
  • IdRef : 078450101

Résumé

Optimizing the operation of cooperative multi-agent systems that can deal with large and realistic problems has become an important focal area of research in the multi-agent community. In this paper we first present a new model, the OC-DEC-MDP (Opportunity Cost Decentralized Markov Decision Processes), that allows for representing large multi-agent decision problems with temporal and precedence constraints. Then, we propose polynomial algorithms to efficiently solve problems formalized by OC-DEC-MDPs. The problems we deal with consist of a set of agents that have to execute a set of tasks in a cooperative way. The agents cannot communicate during execution and they have to respect some resource and temporal constraints. Our approach is based on Decentralized Markov Decision Processes (DEC-MDPs) and uses a concept of opportunity cost borrowed from economics to obtain approximate control policies. Currently, the best existing techniques can only solve optimally small problems. Experimental results show that our approach produces good quality solutions for complex problems which are out of reach of existing approaches.
Fichier principal
Vignette du fichier
BeynierMouaddibJAAMAS.pdf (595.34 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01344444 , version 1 (11-07-2016)

Identifiants

Citer

Aurélie Beynier, Abdel-Illah Mouaddib. Solving efficiently Decentralized MDPs with temporal and resource constraints. Autonomous Agents and Multi-Agent Systems, 2011, 23 (3), pp.486 - 539. ⟨10.1007/s10458-010-9145-2⟩. ⟨hal-01344444⟩
199 Consultations
278 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More