Skip to Main content Skip to Navigation
Conference papers

Combining Reinforcement Learning with a Multi-Level Abstraction Method to Design a Powerful Game AI

Charles Madeira Vincent Corruble 1
1 SMA - Systèmes Multi-Agents
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : This paper investigates the design of a challenging Game AI for a modern strategy game, which can be seen as a large-scale multiagent simulation of an historical military confrontation. As an alternative to the typical script-based approach used in industry, we test an approach where military units and leaders, organized in a hierarchy, learn to improve their collective behavior through playing repeated games. In order to allow the application of a reinforcement learning framework at each level of this complex hierarchical decision-making structure, we propose an abstraction mechanism that adapts semi-automatically the level of detail of the state and action representations to the level of the agent. We also study specifically various reward signals as well as inter-agent communication setups and show their impact on the Game AI performance, distinctively in offensive and defensive modes. The resulting Game AI achieves very good performance when compared with the existing commercial script-based solution.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01287948
Contributor : Lip6 Publications <>
Submitted on : Monday, March 14, 2016 - 1:46:41 PM
Last modification on : Thursday, March 21, 2019 - 2:41:05 PM

Identifiers

Citation

Charles Madeira, Vincent Corruble. Combining Reinforcement Learning with a Multi-Level Abstraction Method to Design a Powerful Game AI. 10th Brazilian Symposium on Games and Digital Entertainment, Nov 2011, Salvador, Brazil. pp.132-140, ⟨10.1109/SBGAMES.2011.21⟩. ⟨hal-01287948⟩

Share

Metrics

Record views

95