Combining latent learning with dynamic programming in the modular anticipatory classifier system - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue European Journal of Operational Research Année : 2005

Combining latent learning with dynamic programming in the modular anticipatory classifier system

Pierre Gérard
  • Fonction : Auteur
Jean-Arcady Meyer
  • Fonction : Auteur
Olivier Sigaud

Résumé

Learning Classifier Systems (LCS) are rule based Reinforcement Learning (RL) systems which use a generalization capability. In this paper, we highlight the differences between two kinds of LCSs. Some are used to directly perform RL while others latently learn a model of the interactions between the agent and its environment. Such a model can be used to speed up the core RL process. Thus, these two kinds of learning processes are complementary. We show here how the notion of generalization differs depending on whether the system anticipates (like Anticipatory Classifier System (ACS) and Yet Another Classifier System (YACS)) or not (like XCS). Moreover, we show some limitations of the formalism common to ACS and YACS, and propose a new system, called Modular Anticipatory Classifier System (MACS), which allows the latent learning process to take advantage of new regularities. We describe how the model can be used to perform active exploration and how this exploration may be aggregated with the policy resulting from the reinforcement learning process. The different algorithms are validated experimentally and some limitations in presence of uncertainties are highlighted.
Fichier principal
Vignette du fichier
2005ACLI414.pdf (382.49 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03124277 , version 1 (28-01-2021)

Identifiants

Citer

Pierre Gérard, Jean-Arcady Meyer, Olivier Sigaud. Combining latent learning with dynamic programming in the modular anticipatory classifier system. European Journal of Operational Research, 2005, 160 (3), pp.614-637. ⟨10.1016/j.ejor.2003.10.004⟩. ⟨hal-03124277⟩
70 Consultations
56 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More