Combining Reinforcement Learning with a Multi-Level Abstraction Method to Design a Powerful Game AI - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

Combining Reinforcement Learning with a Multi-Level Abstraction Method to Design a Powerful Game AI

Charles Madeira
  • Fonction : Auteur
Vincent Corruble

Résumé

This paper investigates the design of a challenging Game AI for a modern strategy game, which can be seen as a large-scale multiagent simulation of an historical military confrontation. As an alternative to the typical script-based approach used in industry, we test an approach where military units and leaders, organized in a hierarchy, learn to improve their collective behavior through playing repeated games. In order to allow the application of a reinforcement learning framework at each level of this complex hierarchical decision-making structure, we propose an abstraction mechanism that adapts semi-automatically the level of detail of the state and action representations to the level of the agent. We also study specifically various reward signals as well as inter-agent communication setups and show their impact on the Game AI performance, distinctively in offensive and defensive modes. The resulting Game AI achieves very good performance when compared with the existing commercial script-based solution.
Fichier non déposé

Dates et versions

hal-01287948 , version 1 (14-03-2016)

Identifiants

Citer

Charles Madeira, Vincent Corruble. Combining Reinforcement Learning with a Multi-Level Abstraction Method to Design a Powerful Game AI. 10th Brazilian Symposium on Games and Digital Entertainment, Nov 2011, Salvador, Brazil. pp.132-140, ⟨10.1109/SBGAMES.2011.21⟩. ⟨hal-01287948⟩
70 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More