Playout Policy Adaptation with Move Features

Tristan Cazenave (1)

1 LAMSADE - Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision

Monte Carlo Tree Search (MCTS) is the state of the art algorithm for General Game Playing (GGP). We propose to learn a playout policy online so as to improve MCTS for GGP. We also propose to learn a policy not only using the moves but also according to the features of the moves. We test the resulting algorithms named Playout Policy Adaptation (PPA) and Playout Policy Adaptation with move Features (PPAF) on Atarigo, Breakthrough, Misere Breakthrough, Domineering, Misere Domineering, Knightthrough, MisereKnightthrough and Nogo. The experiments compare PPA and PPAF to Upper Confidence for Trees (UCT) and to the closely related Move-Average Sampling Technique (MAST) algorithm.

Mots clés: Computer Games; Monte Carlo Tree Search; Reinforcement Learning; Playout policy; Machine learning

Domaines: Informatique [cs]

Tristan Cazenave. Playout Policy Adaptation with Move Features. Theoretical Computer Science, 2016, 644, ⟨10.1016/j.tcs.2016.06.024⟩. ⟨hal-01436210⟩