A Self-Acquiring Knowledge Process for MCTS

André Fabbri 1 Frédéric Armetta 1 Eric Duchene 2 Salima Hassas 1
1 SMA - Systèmes Multi-Agents
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 GOAL - Graphes, AlgOrithmes et AppLications
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : MCTS (Monte Carlo Tree Search) is a well-known and efficient process to cover and evaluate a large range of states for combinatorial problems. We choose to study MCTS for the Computer Go problem, which is one of the most challenging problem in the field of Artificial Intelligence. For this game, a single combinatorial approach does not always lead to a reliable evaluation of the game states. In order to enhance MCTS ability to tackle such problems, one can benefit from game specific knowledge in order to increase the accuracy of the game state evaluation. Such a knowledge is not easy to acquire. It is the result of a constructivist learning mechanism based on the experience of the player. That is why we explore the idea to endow the MCTS with a process inspired by constructivist learning, to self-acquire knowledge from playing experience. In this paper, we propose a complementary process for MCTS called BHRF (Background History Reply Forest), which allows to memorize efficient patterns in order to promote their use through the MCTS process. Our experimental results lead to promising results and underline how self-acquired data can be useful for MCTS based algorithms.
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01233860
Contributor : André Fabbri <>
Submitted on : Wednesday, February 24, 2016 - 10:12:04 AM
Last modification on : Thursday, November 21, 2019 - 2:06:36 AM

Licence


Distributed under a Creative Commons Attribution - NonCommercial - ShareAlike 4.0 International License

Identifiers

Citation

André Fabbri, Frédéric Armetta, Eric Duchene, Salima Hassas. A Self-Acquiring Knowledge Process for MCTS. International Journal on Artificial Intelligence Tools, World Scientific Publishing, 2016, 25 (01), pp.20. ⟨10.1142/S0218213016600071⟩. ⟨hal-01233860⟩

Share

Metrics

Record views

887

Files downloads

66