Monte-Carlo Tree Search by Best Arm Identification - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Monte-Carlo Tree Search by Best Arm Identification

Résumé

Recent advances in bandit tools and techniques for sequential learning are steadily enabling new applications and are promising the resolution of a range of challenging related problems. We study the game tree search problem, where the goal is to quickly identify the optimal move in a given game tree by sequentially sampling its stochastic payoffs. We develop new algorithms for trees of arbitrary depth, that operate by summarizing all deeper levels of the tree into confidence intervals at depth one, and applying a best arm identification procedure at the root. We prove new sample complexity guarantees with a refined dependence on the problem instance. We show experimentally that our algorithms outperform existing elimination-based algorithms and match previous special-purpose methods for depth-two trees.
Fichier principal
Vignette du fichier
KK17arXiv.pdf (326.61 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01535907 , version 1 (09-06-2017)
hal-01535907 , version 2 (05-11-2017)

Identifiants

Citer

Emilie Kaufmann, Wouter M. Koolen. Monte-Carlo Tree Search by Best Arm Identification. NIPS 2017 - 31st Annual Conference on Neural Information Processing Systems, Dec 2017, Long Beach, United States. pp.1-23. ⟨hal-01535907v2⟩
299 Consultations
476 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More