Skip to Main content Skip to Navigation
Conference papers

Continuous Learning of Action and State Spaces (CLASS)

Paul Robertson Olivier L. Georgeon 1, 2
1 SyCoSMA - Systèmes Cognitifs et Systèmes Multi-Agents
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : We present a novel approach to state space discretization for constructivist and reinforcement learning. Constructivist learning and reinforcement learning often operate on a predefined set of states and transitions (state space). AI researchers design algorithms to reach particular goal states in this state space (for example, visualized in the form of goal cells that a robot should reach in a grid). When the size and the dimensionality of the state space increases, however, finding goal states becomes intractable. It is nonetheless assumed that these algorithms can have useful applications in the physical world provided that there is a way to construct a discrete state space of reasonable size and dimensionality. Yet, the manner in which the state space is discretized is the source of many problems for both constructivist and reinforcement learning approaches. The problems can roughly be divided into two categories: (1) wiring too much domain information into the solution, and (2) requiring massive storage to represent the state space (such as Q-tables. The problems relate to (1) the non generality arising from wiring domain information into the solution, and (2) non scalability of the approach to useful domains involving high dimensional state spaces. Another important limitation is that high dimensional state spaces require a massive number of learning trials. We present a new approach that builds upon ideas from place cells and cognitive maps.
Document type :
Conference papers
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-02975529
Contributor : Olivier Georgeon Connect in order to contact the contributor
Submitted on : Thursday, October 22, 2020 - 5:35:48 PM
Last modification on : Tuesday, June 1, 2021 - 2:08:10 PM

Identifiers

  • HAL Id : hal-02975529, version 1

Citation

Paul Robertson, Olivier L. Georgeon. Continuous Learning of Action and State Spaces (CLASS). International Workshop on Self-Supervised Learning, Feb 2020, Boston, United States. pp.15-31. ⟨hal-02975529⟩

Share

Metrics

Record views

30