Skip to Main content Skip to Navigation
Conference papers

Complementary Working Memories using Free-Energy Optimization for Learning Features and Structure in Sequences

Alexandre Pitti 1, 2 Mathias Quoy 1, 2 Catherine Lavandier 1, 2 Sofiane Boucenna 2, 1
ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes
Abstract : We propose a global framework for modeling the cortico-basal system (CX-BG) and the fronto-striatal system (PFC-BG) for the generation and recall of audio memory sequences; ie, sound perception and speech production. Our genuine model is based on the neural architecture called INFERNO standing for Iterative Free-Energy Optimization of Recurrent Neural Networks. Free-energy (FE) corresponds to the prediction error on internal or external noise. FE minimization is used for exploring, selecting and learning in PFC the optimal choices of actions to perform in the BG network (eg sound production) in order to reproduce and control the most accurately possible the spike trains representing sounds in CX. The difference between the two working memories relies in the neural coding itself, which is based on temporal ordering in the CX-BG networks (Spike Timing-Dependent Plasticity) and on the rank ordering in the sequence in the PFC-BG networks (gating or gain-modulation). We detail in this short paper the CX-BG system responsible to encode the audio primitives at few milliseconds order, and the PFC-BG system responsible for the learning of temporal structure in sequences. Two experiments done with a small and a big audio database show the capabilities of exploration, generalization and robustness to noise of the neural architecture to retrieve audio primitives as well as long-range sequences based on structure detection. Although both learning mechanisms are implemented with the same algorithm of rank-order coding, the CX-BG system realizes a model-free recurrent neural network (INFERNO) and the PFC-BG system implements a gated recurrent neural network (INFERNO GATE).
Complete list of metadatas

Cited literature [36 references]  Display  Hide  Download
Contributor : Alexandre Pitti <>
Submitted on : Tuesday, May 26, 2020 - 4:55:39 PM
Last modification on : Monday, January 25, 2021 - 3:16:04 PM


Files produced by the author(s)


  • HAL Id : hal-02626274, version 1



Alexandre Pitti, Mathias Quoy, Catherine Lavandier, Sofiane Boucenna. Complementary Working Memories using Free-Energy Optimization for Learning Features and Structure in Sequences. Workshop Brain PIL New advances in brain-inspired perception, interaction and learning, ICRA2020, May 2020, Virtual, France. ⟨hal-02626274⟩



Record views


Files downloads