Skip to Main content Skip to Navigation
Journal articles

Hippocampal replays under the scrutiny of reinforcement learning models

Abstract : Multiple in vivo studies have shown that place cells from the hippocampus replay previously experienced trajectories. These replays are commonly considered to mainly reflect memory consolidation processes. Some data, however , have highlighted a functional link between replays and reinforcement learning (RL). This theory, extensively used in machine learning, has introduced efficient algorithms and can explain various behavioral and physiological measures from different brain regions. RL algorithms could constitute a mechanistic description of replays, and explain how replays can reduce the number of iterations required to explore the environment during learning. We review here the main findings concerning the different hippocampal replay types and the possible associated RL models (either model-based, model-free or hybrid model types). We conclude by tying these frameworks together. We illustrate the link between data and RL through a series of model simulations. This review, at the frontier between informatics and biology, paves the way for future work on replays.
Document type :
Journal articles
Complete list of metadata

Cited literature [98 references]  Display  Hide  Download
Contributor : Mehdi Khamassi <>
Submitted on : Monday, October 21, 2019 - 5:20:12 PM
Last modification on : Wednesday, May 19, 2021 - 11:58:13 AM
Long-term archiving on: : Wednesday, January 22, 2020 - 8:44:45 PM


Files produced by the author(s)



Romain Cazé, Mehdi Khamassi, Lise Aubin, Benoît Girard. Hippocampal replays under the scrutiny of reinforcement learning models. Journal of Neurophysiology, American Physiological Society, 2018, ⟨10.1152/jn.00145.2018⟩. ⟨hal-02323528⟩



Record views


Files downloads