Factors that influence the relative use of multiple memory systems, Hippocampus, vol.23, issue.11, pp.1044-1052, 2013. ,
Contributions of striatal subregions to place and response learning, Learn & Mem, vol.11, issue.4, pp.459-463, 2004. ,
The role of the dorsomedial striatum in instrumental conditioning, Eur J Neurosci, vol.22, pp.513-523, 2005. ,
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control, Nat Neurosci, vol.8, issue.12, pp.1704-1711, 2005. ,
The role of the basal ganglia in habit formation, Nat Rev Neurosci, pp.464-76, 2006. ,
Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning, Neuron, vol.66, pp.781-795, 2010. ,
Multiplicity of control in the basal ganglia: computational roles of striatal subregions, Curr Opin Neurobiol, vol.21, pp.374-380, 2011. ,
Integrating cortico-limbic-basal ganglia architectures for learning modelbased and model-free navigation strategies, Front Behav Neurosci, vol.6, 2012. ,
URL : https://hal.archives-ouvertes.fr/hal-01219958
A Computational Model of Parallel Navigation Systems in Rodents, Neuroinformatics, vol.3, issue.3, pp.223-242, 2005. ,
Integration of navigation and action selection functionalities in a computational model of cortico-basal-thalamo-cortical loops, Adapt Behav, vol.13, issue.2, pp.115-130, 2005. ,
URL : https://hal.archives-ouvertes.fr/hal-00016389
Speed/Accuracy trade-off between the habitual and goal-directed processes, PLoS Comput Biol, vol.7, issue.5, pp.1-25, 2011. ,
Modelling individual differences observed in Pavlovian autoshaping in rats using a dual learning systems approach and factored representations, PLoS Comput Biol, vol.10, issue.2, p.1003466, 2014. ,
Analyzing Interactions between Navigation Strategies Using a Computational Model of Action Selection, Spatial Cognition VI, vol.5248, pp.71-86, 2008. ,
Path planning versus cue responding: A bioinspired model of switching between navigation strategies, Biol Cybern, vol.103, issue.4, p.20617443, 2010. ,
Information processing in decision-making systems, The Neuroscientist, vol.18, issue.4, pp.342-359, 2012. ,
Parallel information processing in the dorsal striatum: Relation to hippocampal functions, J Neurosci, vol.19, issue.7, pp.2789-2798, 1999. ,
A model of hippocampally dependent navigation, using the temporal difference learning rule, Hippocampus, vol.10, issue.1, pp.1-16, 2000. ,
The mixed instrumental controller: using value of information to combine habitual choice and mental simulation, Front Psychol, vol.4, p.92, 2013. ,
Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning, Front Behav Neurosci, vol.9, 2015. ,
URL : https://hal.archives-ouvertes.fr/hal-01215419
Design of a Control Architecture for Habit Learning in Robots, Biomimetic and Biohybrid Systems, LNAI Proceedings, pp.249-260, 2014. ,
URL : https://hal.archives-ouvertes.fr/hal-01312443
How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis, Eur J Neurosci, vol.35, issue.7, p.22487033, 2012. ,
Adaptive coordination of working-memory and reinforcement learning in non-human primates performing a trial-and-error problem solving task, Behav Brain Res, 2017. ,
URL : https://hal.archives-ouvertes.fr/hal-01624253
Neuronal computations underlying the firing of place cells and their role in navigation, Hippocampus, vol.6, issue.6, pp.749-762, 1996. ,
Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity, Biol Cybern, vol.83, issue.3, pp.287-299, 2000. ,
Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model, Psychol Rev, vol.122, issue.1, p.54, 2015. ,
Integrated Systems of the CNS, Part III, Handbook of chemical neuroanatomy. vol, vol.12, pp.371-468, 1996. ,
The basal ganglia: a vertebrate solution to the selection problem?, Neuroscience, vol.89, pp.1009-1024, 1999. ,
Layered control architectures in robots and vertebrates, Adapt Behav, vol.7, pp.99-127, 1999. ,
Actor-critic models of the basal ganglia: new anatomical and computational perspectives, Neural Netw, vol.15, issue.4, pp.47-50, 2002. ,
Actor-critic models of reinforcement learning in the basal ganglia: from natural to artificial rats, Adapt Behav, vol.13, issue.2, pp.131-148, 2005. ,
URL : https://hal.archives-ouvertes.fr/hal-00016390
Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal, Psychol Rev, vol.113, issue.2, pp.300-326, 2006. ,
Evolutionary conservation of the basal ganglia as a common vertebrate mechanism for action selection, Current Biol, vol.21, issue.13, pp.1081-1091, 2011. ,
Episodes in space: A modelling study of hippocampal place representation, LNAI, vol.5040, pp.123-136, 2008. ,
Place navigation impaired in rats with hippocampal lesions, Nature, vol.297, issue.5868, pp.681-683, 1982. ,
Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP 5, Hippocampus, vol.9, issue.2, pp.118-136, 1999. ,
Hippocampal lesions disrupt navigation based on cognitive maps but not heading vectors, Nature, vol.396, issue.6706, pp.75-77, 1998. ,
Generalization gradients in a navigation task with rats, Learning and Motivation, vol.37, issue.3, pp.247-268, 2006. ,
Blocking in the Morris swimming pool, J Exp Psychol Anim Behav Process, vol.25, issue.2, pp.225-235, 1999. ,
Do animals have cognitive maps?, J Exp Biol, vol.199, issue.1, pp.219-224, 1996. ,
Evidence against integration of spatial maps in humans: generality across real and virtual environments, Animal Cognition, vol.12, issue.2, p.18766392, 2009. ,
Rodent models of prefrontal cortical function, Trends Neurosci, vol.25, issue.7, pp.2164-2165, 2002. ,
Absence of an Interaction Between Navigational Strategies Based on Local and Distal Landmarks, J Exp Psychol Anim Behav Process, vol.30, issue.1, pp.34-44, 2004. ,
The 36th Sir Frederick Bartlett Lecture: An associative analysis of spatial learning, Quat J Exp Psychol, vol.62, issue.1, pp.1665-1684, 2009. ,
Multiple parallel memory systems in the brain of the rat, Neurobiol Learn Mem, vol.77, pp.125-184, 2002. ,
Selective suppression of hippocampal ripples impairs spatial memory, Nat Neurosci, vol.12, issue.10, pp.1222-1223, 2009. ,
URL : https://hal.archives-ouvertes.fr/hal-00599372
Biologically-based artificial navigation systems: review and prospects, Prog Neurobiol, vol.83, issue.3, pp.271-285, 1997. ,
URL : https://hal.archives-ouvertes.fr/hal-00618346
Beyond the cognitive map: From place cells to episodic memory, 1999. ,
Complementary roles of the rat prefrontal cortex and striatum in reward-based learning and shifting navigation strategies. UPMC. PhD thesis, 2007. ,
URL : https://hal.archives-ouvertes.fr/tel-00688927
Task-dependent encoding of space and events by striatal neurons is dependent on neural subtype, Neurosci, vol.153, pp.349-360, 2008. ,
Spatial navigation: Spatial learning in real and virtual environments, Comp Cog Behav Rev, vol.2, pp.111-124, 2007. ,
Associative Basis of Landmark Learning and Integration in Vertebrates, Comp Cog Behav Rev, vol.4, pp.80-102, 2009. ,
Conditioned reflexes, 1927. ,
The behavior of organisms, 1938. ,
, Readings in the History of Psychology, 1913.
A theory of Pavlovian conditioning: The effectiveness of reinforcement and non-reinforcement, pp.64-69, 1972. ,
Cognitive Maps in Rats and Men, Psychol Rev, vol.55, issue.4, pp.189-208, 1948. ,
The hippocampus as a spatial map. preliminary evidence from unit activity in the freely-moving rat, Brain Res, vol.34, issue.1, pp.90358-90359, 1971. ,
Spatial localisation does not require the presence of local cues, Learning and Motivation, vol.12, pp.239-260, 1981. ,
Multiple memory systems: The power of interactions, Neurobiol Learn Mem, vol.82, issue.3, pp.333-346, 2004. ,
The challenges of understanding mammalian cognition and memory-based behaviours: an interactive learning and memory systems approach. Neurosci Biobehav Rev, vol.28, pp.719-745, 2004. ,
The role of stimulus ambiguity and movement in spatial navigation: a multiple memory systems analysis of location discrimination, Neurobiol Learn Mem, vol.82, pp.216-229, 2004. ,
Lesions of the medial shell of the nucleus accumbens impair rats in finding larger rewards, but spare reward-seeking behavior, Behav Brain Res, vol.117, issue.1-2, pp.173-83, 2000. ,
URL : https://hal.archives-ouvertes.fr/hal-00618317
The cognitive functions of the caudate nucleus, Prog Neurobiol, vol.86, issue.3, pp.141-155, 2008. ,
Medial prefrontal lesions in the rat and spatial navigation: Evidence for impaired planning, Behav Neurosci, vol.109, issue.3, pp.474-484, 1995. ,
URL : https://hal.archives-ouvertes.fr/hal-01385317
Distinct striatal regions for planning and executing novel and automated movement sequences, Neuroimage, vol.44, issue.4, pp.1369-1379, 2009. ,
Inactivation of hippocampus or caudate nucleus with lidocaine differentially affects expression of place and response learning, Neurobiol Learn Mem, vol.65, issue.1, pp.65-72, 1996. ,
Some highlights of research on the effects of caudate nucleus lesions over the past 200 years, Behav Brain Res, vol.199, issue.1, pp.3-23, 2009. ,
Parallel information processing in the water maze: evidence for independent memory systems involving dorsal striatum and hippocampus, Behav Neural Biol, vol.61, issue.3, pp.260-70, 1994. ,
Double dissociation of fornix and caudate nucleus lesions on acquisition of two water maze tasks: further evidence for multiple memory systems, Behav Neurosci, vol.106, issue.3, pp.439-446, 1992. ,
The Hippocampus and Spatial Memory: Findings with a Novel Modification of the Water Maze, J Neurosci, vol.27, issue.25, pp.6647-6654, 2007. ,
Evidence for a shift from place navigation to directional responding in one variant of the Morris water task, J Exp Psychol Anim Behav Process, vol.35, issue.2, pp.271-278, 2009. ,
Coordination of multiple memory systems, Neurobiol Learn Mem, vol.82, issue.3, pp.230-242, 2004. ,
Complementary memory systems: Competition, cooperation and compensation, Trends Neurosci, vol.28, issue.4, pp.169-170, 2005. ,
Multiple brain-memory systems: The whole does not equal the sum of its parts, Trends Neurosci, vol.24, issue.6, pp.324-354, 2001. ,
Competition among multiple memory systems: Converging evidence from animal and human brain studies, Neuropsychology, vol.41, issue.3, pp.157-161, 2003. ,
Switching memory systems during learning: Changes in patterns of brain acetylcholine release in the hippocampus and striatum in rats, J Neurosci, vol.23, issue.7, pp.3001-3005, 2003. ,
Interaction between the human hippocampus and the caudate nucleus during route recognition, Neuron, vol.43, issue.3, pp.427-435, 2004. ,
Acetylcholine release in the hippocampus and striatum during place and response training, Learn & Mem, vol.12, issue.6, pp.564-572, 2005. ,
Involvement of the Prelimbic-Infralimbic Areas of the Rodent Prefontal Cortex in Behavioral Flexibility for Place and Response Learning, J Neurosci, vol.19, issue.11, pp.4585-4594, 1999. ,
Separate neural substrates for skill learning and performance in the ventral and dorsal striatum, Nat Neurosci, vol.10, pp.126-131, 2007. ,
The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward, Prog Neurobiol, vol.90, pp.385-417, 2010. ,
Ventral striatum: a critical look at models o learning and evaluation, Curr Opin Neurobiol, vol.21, issue.3, pp.387-392, 2011. ,
Spatial Learning and Action Planning in a Prefrontal Cortical Network Model, PLoS Comput Biol, vol.7, issue.5, 2011. ,
URL : https://hal.archives-ouvertes.fr/hal-00683093
A biologically inspired meta-control navigation system for the Psikharpax rat robot, Bioinsp & Biomim, vol.7, issue.2, p.25009, 2012. ,
URL : https://hal.archives-ouvertes.fr/hal-01000945
Heading-vector navigation based on head-direction cells and path integration, Hippocampus, vol.19, issue.5, pp.456-479, 2009. ,
, Spatial cognitive maps in animals: New hypotheses on their structure and neural mechanisms, vol.100, pp.163-182, 1993.
An Analysis of Response, Direction, and Place Learning in an Open Field and T Mazes, J Exp Psychol Anim Behav Process, vol.29, pp.3-13, 2003. ,
Cognitive maps not used by humans (Homo sapiens) during a dynamic navigational task, J Comp Psychol, vol.115, issue.4, p.397, 2001. ,
Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory, Proc Natl Acad Sci, vol.105, issue.15, pp.5915-5920, 2008. ,
Distinct error-correcting and incidental learning of location relative to landmarks and boundaries, Proc Natl Acad Sci, vol.105, issue.15, pp.5909-5914, 2008. ,
The relative influence of place and direction in the Morris water task, J Exp Psychol Anim Behav Process, vol.34, issue.1, pp.31-53, 2008. ,
Distal landmarks and hippocampal place cells: effects of relative translation versus rotation, Hippocampus, vol.13, issue.5, pp.604-617, 2003. ,
States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning, Neuron, vol.66, issue.4, pp.585-595, 2010. ,
Prefrontal-hippocampal interactions in episodic memory, Nat Rev Neurosci, vol.18, issue.9, p.547, 2017. ,
Organizing conceptual knowledge in humans with a grid-like code, Science, vol.352, issue.6292, pp.1464-1468, 2016. ,
A map for social navigation in the human brain, Neuron, vol.87, issue.1, pp.231-243, 2015. ,
Integrating memories to guide decisions, Curr Opin Behav Sci, vol.5, pp.85-90, 2015. ,
Feedback timing modulates brain systems for learning in humans, J Neurosci, vol.31, issue.37, pp.13157-13167, 2011. ,
The role of the basal ganglia in learning and memory: insight from Parkinson's disease, Neurobiol Learn & Mem, vol.96, issue.4, pp.624-636, 2011. ,
Human orbitofrontal cortex represents a cognitive map of state space, Neuron, vol.91, issue.6, pp.1402-1412, 2016. ,
Coherent theta oscillations and reorganization of spike timing in the hippocampal-prefrontal network upon learning, Neuron, vol.66, issue.6, pp.921-936, 2010. ,
URL : https://hal.archives-ouvertes.fr/hal-00554482
The phasic dopamine signal maturing: from reward via behavioural activation to formal economic utility, Curr Opin Neurobiol, vol.43, pp.139-148, 2017. ,
Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events, Neuron, vol.60, issue.2, pp.378-389, 2008. ,
Reinforcement learning: an introduction, 1998. ,
Hippocampal replays under the scrutiny of reinforcement learning models, 2018. ,
VTA neurons coordinate with the hippocampal reactivation of spatial experience, Elife, vol.4, 2015. ,
Combining self-organizing maps with mixture of experts: application to an actor-critic of reinforcement learning in the basal ganglia, Proceedings of the 9th International Conference on the Simulation of Adaptive Behavior, pp.394-405, 2006. ,
Multiple model-based reinforcement learning. Neural Computation, vol.14, pp.1347-1369, 2002. ,
Stress, genotype and norepinephrine in the prediction of mouse behavior using reinforcement learning, Nat Neurosci, vol.12, issue.9, pp.1180-1186, 2009. ,
Learning the value of information in an uncertain world, Nature neuroscience, vol.10, issue.9, p.1214, 2007. ,
Midbrain dopamine neurons encode decisions for future action, Nat Neurosci, vol.9, issue.8, pp.1057-1063, 2006. ,
Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards, Nat Neurosci, vol.10, issue.12, pp.1615-1624, 2007. ,
Choice values, Nature neuroscience, vol.9, issue.8, pp.987-988, 2006. ,
Dopamine: at the intersection of reward and action, Nat Neurosci, vol.10, issue.12, pp.1505-1507, 2007. ,
Which Temporal Difference Learning algorithm best reproduces dopamine activity in a multi-choice task?, Proceedings of the 12th International Conference on Adaptive Behaviour, pp.289-298, 2012. ,
URL : https://hal.archives-ouvertes.fr/hal-00731475
Dopamine neurons phasic activity does not encode the reward prediction error that behavioral adaptation would predict, 2018. ,
, The Other End of the Spectrum, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01374786
Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis, J Neurosci, vol.10, issue.2, pp.420-435, 1990. ,
Analyzing interactions between cue-guided and place-based navigation with a computational model of action selection: Influence of sensory cues and training, Proceedings of the 11th International Conference on Simulation of Adaptive Behavior (SAB 2010), pp.335-346, 2010. ,
A note on two problems in connection with graphs, Numerische Mathematik, vol.1, pp.269-271, 1959. ,
Affordances, motivation, and the world graph theory, Adapt Behav, vol.6, issue.3, pp.435-471, 1998. ,
Applications of the Morris water maze in the study of learning and memory, Brain Res Rev, vol.36, issue.1, pp.60-90, 2001. ,
What do the basal ganglia do? A modeling perspective, Biol Cybern, vol.103, issue.3, p.20644953, 2010. ,
Robust self-localisation and navigation based on hippocampal place cells, Neural Network, vol.18, issue.9, pp.1125-1140, 2005. ,