Skip to Main content Skip to Navigation
Journal articles

UCD : Upper confidence bound for rooted directed acyclic graphs

Abstract : In this paper we present a framework for testing various algorithms that deal with transpositions in Monte-Carlo Tree Search (MCTS). We call this framework Upper Confidence bound for Direct acyclic graphs (UCD) as it constitutes an extension of Upper Confidence bound for Trees (UCT) for Direct acyclic graphs (DAG).When using transpositions in MCTS, a DAG is progressively developed instead of a tree. There are multiple ways to handle the exploration exploitation dilemma when dealing with transpositions. We propose parameterized ways to compute the mean of the child, the playouts of the parent and the playouts of the child. We test the resulting algorithms on several games. For all games, original configurations of our algorithms improve on state of the art algorithms.
Document type :
Journal articles
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01499672
Contributor : Christine Okret-Manville <>
Submitted on : Friday, March 31, 2017 - 6:24:30 PM
Last modification on : Monday, August 3, 2020 - 3:40:44 AM
Document(s) archivé(s) le : Saturday, July 1, 2017 - 3:40:17 PM

File

UCD _ Upper Confidence bound f...
Files produced by the author(s)

Identifiers

Citation

Tristan Cazenave, Jean Méhat, Abdallah Saffidine. UCD : Upper confidence bound for rooted directed acyclic graphs. Knowledge-Based Systems, Elsevier, 2012, 34, pp.26-33. ⟨10.1016/j.knosys.2011.11.014⟩. ⟨hal-01499672⟩

Share

Metrics

Record views

235

Files downloads

1299