.. Experimental-results, 106 4.3.1 Protocol B: Formation of habits, p.106

M. Topalidou-bibliography-aizman, O. Brismar, H. Uhlen, P. Zettergren, E. Levey et al., Anatomical and physiological evidence for D1 and D2 dopamine receptor colocalization in neostriatal neurons, Nature Neuroscience, vol.3, 2000.

R. L. Albin, A. B. Young, and J. B. Penney, The functional anatomy of basal ganglia disorders, Trends in Neurobiology, issue.10, p.12366, 1989.

G. Alexander, M. Cruthcer, D. Long, and M. , Chapter 6 Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, ???prefrontal??? and ???limbic??? functions, Prog Brain Res, vol.85, pp.119-146, 1991.
DOI : 10.1016/S0079-6123(08)62678-3

G. E. Alexander, M. R. Delong, and P. L. Strick, Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and Cortex, Annual Review of Neuroscience, vol.9, issue.1, pp.357-381, 1986.
DOI : 10.1146/annurev.ne.09.030186.002041

G. W. Arbuthnott, C. A. Ingham, and J. R. Wickens, Dopamine and synaptic plasticity in the neostriatum, Journal of Anatomy, vol.196, issue.4, pp.587-596, 2000.
DOI : 10.1046/j.1469-7580.2000.19640587.x

G. F. Ashby and J. M. Ennis, The Role of the Basal Ganglia in Category Learning, Psychol. Learn. Mem, vol.46, pp.1-36, 2006.
DOI : 10.1016/S0079-7421(06)46001-1

G. F. Ashby, J. M. Ennis, and B. J. Spiering, A neurobiological theory of automaticity in perceptual categorization., Psychological Review, vol.114, issue.3, pp.632-656, 2007.
DOI : 10.1037/0033-295X.114.3.632

G. F. Ashby, B. O. Turner, and J. C. Horvitz, Cortical and basal ganglia contributions to habit learning and automaticity, Trends in Cognitive Sciences, vol.14, issue.5, pp.208-215, 2010.
DOI : 10.1016/j.tics.2010.02.001
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2862890

G. Baldassarre, F. Mannella, V. G. Fiore, P. Redgrave, K. Gurney et al., Intrinsically motivated action???outcome learning and goal-based action recall: A system-level bio-constrained computational model, Neural Networks, vol.41, pp.168-187, 2013.
DOI : 10.1016/j.neunet.2012.09.015

B. W. Balleine, M. R. Delgado, and O. Hikosaka, The Role of the Dorsal Striatum in Reward and Decision-Making, Journal of Neuroscience, vol.27, issue.31, pp.8161-8165, 2007.
DOI : 10.1523/JNEUROSCI.1554-07.2007

B. W. Balleine, M. Lijeholm, and S. B. Ostlund, The integrative function of the basal ganglia in instrumental conditioning, Behavioural Brain Research, vol.199, issue.1, pp.43-52, 2009.
DOI : 10.1016/j.bbr.2008.10.034

B. W. Balleine, O. Doherty, and J. P. , Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action, Neuropsychopharmacology, vol.20, issue.1, pp.48-69, 2010.
DOI : 10.1016/S0149-7634(99)00065-2

I. Bar-gad, G. Morris, and H. Bergman, Information processing, dimensionality reduction and reinforcement learning in the basal ganglia, Progress in Neurobiology, vol.71, issue.6, pp.439-473, 2003.
DOI : 10.1016/j.pneurobio.2003.12.001

X. Barandiaran, D. Paolo, and E. A. , A genealogical map of the concept of habit, Frontiers in Human Neuroscience, vol.114, issue.522, 2014.
DOI : 10.1037/0033-295X.114.4.843

A. G. Barto, Adaptive critics and the basal ganglia, Models of Information Processing in the Basal Ganglia, 1995.

M. Topalidou, B. Belin, D. Jonkman, S. Dickinson, A. Robbins et al., Parallel and interactive learning processes with the basal ganglia: Relevance for the understanding of addiction, Behavioural Brain Research, vol.199, pp.89-102, 2009.

A. L. Benabid, Deep brain stimulation for Parkinson???s disease, Current Opinion in Neurobiology, vol.13, issue.6, pp.696-706, 2003.
DOI : 10.1016/j.conb.2003.11.001

J. Bernacer and J. I. Murillo, The Aristotelian conception of habit and its contribution to human neuroscience, Frontiers in Human Neuroscience, vol.7, issue.883, 2014.
DOI : 10.1038/nrn1919

M. Bevan, P. Booth, S. Eaton, and J. Bolam, Selective innervation of neostriatal interneurons by a subclass of neurons in the globus pallidus of rats, Journal of Neuroscience, vol.18, issue.22, pp.9438-9452, 1998.

T. Boraud, Matière à décision, CNRS Editions, 2015.

G. E. Box and N. R. Draper, Empirical Model-Building and Response Surfaces, 1987.

L. A. Bradfield, J. Bertran-gonzalez, B. Chieng, and B. W. Balleine, The Thalamostriatal Pathway and Cholinergic Control of Goal-Directed Action: Interlacing New with Existing Learning in the Striatum, Neuron, vol.79, issue.1, pp.153-166, 2013.
DOI : 10.1016/j.neuron.2013.04.039

A. Brovelli, B. Nazarian, M. Meunier, and D. Boussaoud, Differential roles of caudate nucleus and putamen during instrumental learning, NeuroImage, vol.57, issue.4, pp.1580-1590, 2011.
DOI : 10.1016/j.neuroimage.2011.05.059

P. Calabresi, B. Picconi, A. Tozzi, V. Ghiglieri, D. Filippo et al., Direct and indirect pathways of basal ganglia: a critical reappraisal, Nature Neuroscience, vol.86, issue.8, pp.1022-1030, 2006.
DOI : 10.1038/466449a

P. Calabresi, A. Pisani, N. B. Mercuri, and G. Bernardi, The corticostriatal projection: from synaptic plasticity to dysfunctions of the basal ganglia, Trends in Neurosciences, vol.19, issue.1, pp.19-24, 1996.
DOI : 10.1016/0166-2236(96)81862-5

R. M. Carelli, M. Wolske, and M. O. West, Loss of lever press-related firing of rat striatal forelimb neurons after repeated sessions in a lever pressing task, Journal of Neuroscience, vol.17, pp.1804-1814, 1997.

M. Cazorla, F. Delmondes-de-carvalho, M. O. Chohan, M. Shegda, N. Chuhma et al., Dopamine D2 Receptors Regulate the Anatomical and Functional Balance of Basal Ganglia Circuitry, Neuron, vol.81, issue.1, pp.153-164, 2014.
DOI : 10.1016/j.neuron.2013.10.041

N. Chomsky, Reviews, <i>WORD</i>, vol.15, issue.1, pp.26-58, 1959.
DOI : 10.1080/00437956.1959.11659695

P. Cisek, Cortical mechanisms of action selection: the affordance competition hypothesis, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.20, issue.1, pp.1585-1599, 2007.
DOI : 10.1146/annurev.neuro.20.1.25

M. X. Cohen and M. J. Frank, Neurocomputational models of basal ganglia function in learning, memory and choice, Behavioural Brain Research, vol.199, issue.1, pp.141-156, 2009.
DOI : 10.1016/j.bbr.2008.09.029

N. J. Cohen and L. R. Squire, Preserved learning and retention of pattern-analyzing skill in amnesia: dissociation of knowing how and knowing that, Science, vol.210, issue.4466, pp.207-210, 1980.
DOI : 10.1126/science.7414331

R. M. Colwill and R. A. Rescorla, Associative structures in instrumental learning The psychology of learning and motivation, pp.55-104, 1995.

G. Cui, S. B. Jun, X. Jin, M. D. Pham, S. S. Vogel et al., Concurrent activation of striatal direct and indirect pathways during action initiation, Nature, vol.154, issue.7436, pp.238-242, 2013.
DOI : 10.1038/nature11846

M. Topalidou, B. Da-cunha, C. Gomez-a, A. Blaha, and C. D. , The role of basal ganglia in motivated behavior, Rev. Neurosci, vol.23, issue.5-6, pp.747-767, 2012.

N. D. Daw, Y. Niv, and P. Dayan, Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control, Nature Neuroscience, vol.58, issue.12, pp.1704-1711, 1560.
DOI : 10.1038/nn1560

N. D. Daw and K. Doya, The computational neurobiology of learning and reward, Current Opinion in Neurobiology, vol.16, issue.2, pp.199-204, 2006.
DOI : 10.1016/j.conb.2006.03.006

N. D. Daw, S. J. Gershman, B. Seymour, P. Dayan, and R. J. Dolan, Model-Based Influences on Humans' Choices and Striatal Prediction Errors, Neuron, vol.69, issue.6, pp.1204-1215, 2011.
DOI : 10.1016/j.neuron.2011.02.027
URL : http://doi.org/10.1016/j.neuron.2011.02.027

P. Dayan and K. C. Berridge, Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation, Cognitive, Affective, & Behavioral Neuroscience, vol.494, issue.Suppl. 1, pp.473-492, 2014.
DOI : 10.1371/journal.pcbi.1000437
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4074442

M. R. Delgado, J. Li, D. Schiller, and E. A. Phelps, The role of the striatum in aversive learning and aversive prediction errors, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.302, issue.3, 2008.
DOI : 10.1002/cne.903020302

M. R. Delong, Primate models of movement disorders of basal ganglia origin, Trends in Neurosciences, vol.13, issue.7, pp.281-285, 1990.
DOI : 10.1016/0166-2236(90)90110-V

J. Deniau, A. Menetrey, and S. Charpier, The lamellar organization of the rat substantia nigra pars reticulata: Segregated patterns of striatal afferents and relationship to the topography of corticostriatal projections, Neuroscience, vol.73, issue.3, pp.761-781, 1996.
DOI : 10.1016/0306-4522(96)00088-7

A. Dezfouli and B. W. Balleine, Actions, Action Sequences and Habits: Evidence That Goal-Directed and Habitual Action Control Are Hierarchically Organized, PLoS Computational Biology, vol.106, issue.3, 2013.
DOI : 10.1371/journal.pcbi.1003364.t002
URL : http://doi.org/10.1371/journal.pcbi.1003364

A. Dickinson, Actions and Habits: The Development of Behavioural Autonomy, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.308, issue.1135, pp.67-78, 1985.
DOI : 10.1098/rstb.1985.0010

A. Dickinson and B. W. Balleine, Hedonics: The cognitive? motivational interface, Pleasures of the brain, pp.74-84, 2010.

A. Dickinson and B. W. Balleine, Actions and responses: The dual psychology of behaviour, Spatial Representation: Problems in Philosophy and Psychology, pp.277-293, 1993.

L. Ding and J. I. Gold, The Basal Ganglia???s Contributions to Perceptual Decision Making, Neuron, vol.79, issue.4, 2013.
DOI : 10.1016/j.neuron.2013.07.042

R. J. Dolan and P. Dayan, Goals and Habits in the Brain, Neuron, vol.80, issue.2, pp.312-325, 2013.
DOI : 10.1016/j.neuron.2013.09.007

K. Doya, What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?, Neural Networks, vol.12, issue.7-8, pp.961-974, 1999.
DOI : 10.1016/S0893-6080(99)00046-5

M. S. Feenstra and M. H. Botterblom, Rapid sampling of extracellular dopamine in the rat prefrontal cortex during food consumption, handling and exposure to novelty, Brain Research, vol.742, issue.1-2, pp.17-24, 1996.
DOI : 10.1016/S0006-8993(96)00945-6

J. Fodor, The Modularity of Mind, 1983.

K. Foerde and D. Shohamy, The role of the basal ganglia in learning and memory: Insight from Parkinson???s disease, Neurobiology of Learning and Memory, vol.96, issue.4, pp.624-636, 2011.
DOI : 10.1016/j.nlm.2011.08.006

M. Topalidou, B. Frank, and M. J. , Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and non-mediacated parkinsonism, J. Cogn. Neurosci, vol.17, pp.51-72, 2005.

D. M. Friend and A. V. Kravitz, Working together: basal ganglia pathways in action selection, Trends in Neurosciences, vol.37, issue.6, 2014.
DOI : 10.1016/j.tins.2014.04.004
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4041812

J. M. Fuster, The Prefrontal Cortex???An Update, Neuron, vol.30, issue.2, pp.319-333, 2001.
DOI : 10.1016/S0896-6273(01)00285-9

J. T. Gale, R. Amirnovin, Z. M. Williams, A. W. Flaherty, and E. N. Eskandar, From symphony to cacophony: Pathophysiology of the human basal ganglia in Parkinson disease, Neuroscience & Biobehavioral Reviews, vol.32, issue.3, pp.378-387, 2008.
DOI : 10.1016/j.neubiorev.2006.11.005

C. R. Gerfen, T. M. Engber, L. C. Mahan, Z. Susel, T. N. Chase et al., D1 and D2 dopamine receptor-regulated gene expression of striatonigral and striatopallidal neurons, Science, vol.250, issue.4986, pp.1429-1432, 1990.
DOI : 10.1126/science.2147780

C. M. Gillan, M. Papmeyer, S. Morein-zamir, B. J. Sahakian, N. A. Fineberg et al., Disruption in the Balance Between Goal-Directed Behavior and Habit Learning in Obsessive-Compulsive Disorder, American Journal of Psychiatry, vol.168, issue.7, pp.718-726, 2011.
DOI : 10.1176/appi.ajp.2011.10071062

B. Girard, N. Tabareaua, Q. C. Phama, A. Berthoza, and J. Slotineb, Where neuroscience and dynamic system theory meet autonomous robotics: A contracting basal ganglia model for action selection, Neural Networks, vol.21, issue.4, pp.628-641, 2008.
DOI : 10.1016/j.neunet.2008.03.009
URL : https://hal.archives-ouvertes.fr/hal-00287596

P. Graf and D. L. Schacter, Implicit and explicit memory for new associations in normal and amnesic subjects., Journal of Experimental Psychology: Learning, Memory, and Cognition, vol.11, issue.3, pp.501-518, 1985.
DOI : 10.1037/0278-7393.11.3.501

B. Graybiel and A. M. , The basal ganglia: learning new tricks and loving it, Current Opinion in Neurobiology, vol.15, issue.6, pp.638-644, 2005.
DOI : 10.1016/j.conb.2005.10.006

A. M. Graybiel, Habits, Rituals, and the Evaluative Brain, Annual Review of Neuroscience, vol.31, issue.1, pp.359-387, 2008.
DOI : 10.1146/annurev.neuro.29.051605.112851

A. M. Graybiel, T. Aosaki, A. Flaherty, and M. Kimura, The basal ganglia and adaptive motor control, Science, vol.265, issue.5180, pp.1826-1831, 1994.
DOI : 10.1126/science.8091209

A. M. Graybiel and S. T. Grafton, The Striatum: Where Skills and Habits Meet, Cold Spring Harbor Perspectives in Biology, vol.7, issue.8, 2015.
DOI : 10.1101/cshperspect.a021691

K. Gurney, T. J. Prescott, and P. Redgrave, A computational model of action selection in the basal ganglia. I. A new functional anatomy, Biological Cybernetics, vol.84, issue.6, pp.401-410, 2001.
DOI : 10.1007/PL00007984

K. Gurney, T. J. Prescott, and P. Redgrave, A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour, Biological Cybernetics, vol.84, issue.6, pp.411-423, 2001.
DOI : 10.1007/PL00007985

M. Guthrie, A. Leblois, A. Garenne, and T. Boraud, Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study, Journal of Neurophysiology, vol.109, issue.12, pp.3025-3040, 2013.
DOI : 10.1152/jn.00026.2013
URL : https://hal.archives-ouvertes.fr/hal-00828004

S. N. Haber, The primate basal ganglia: parallel and integrative networks, Journal of Chemical Neuroanatomy, vol.26, issue.4, pp.317-330, 2003.
DOI : 10.1016/j.jchemneu.2003.10.003

L. J. Hammond, The effect of contingency upon the appetitive conditioning of free-operant behavior, Journal of the Experimental Analysis of Behavior, vol.34, issue.3, pp.297-304, 1980.
DOI : 10.1901/jeab.1980.34-297

M. Topalidou, B. Hazrati, L. Parent, and A. , Convergence of subthalamic and striatal efferents at pallidal level in primates: an anterograde double-labeling study with biocytin and pha-l, Brain Res, vol.569, pp.336-340, 1992.

L. Hazrati and A. Parent, Differential patterns of arborization of striatal and subthalamic fibers in the two pallidal segments in primates, Brain Research, vol.598, issue.1-2, pp.311-315, 1992.
DOI : 10.1016/0006-8993(92)90199-J

S. Hélie, S. W. Ell, and G. F. Ashby, Learning robust cortico-cortical associations with the basal ganglia: An integrative review, Cortex, vol.64, pp.123-135, 2015.
DOI : 10.1016/j.cortex.2014.10.011

R. J. Herrnsteing, W. Vaughan, J. D. Mumford, and S. M. Kosslyn, Teaching pigeons an abstract relational rule: Insideness, Perception & Psychophysics, vol.30, issue.1, pp.56-64, 1989.
DOI : 10.3758/BF03208074

O. Hikosaka and M. Isoda, Switching from automatic to controlled behavior: cortico-basal ganglia mechanisms, Trends in Cognitive Sciences, vol.14, issue.4, 2010.
DOI : 10.1016/j.tics.2010.01.006
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2847883

J. Hirsh, The hippocampus and contextual retrieval of information from memory: A theory, Behavioral Biology, vol.12, issue.4, pp.421-444, 1974.
DOI : 10.1016/S0091-6773(74)92231-7

J. R. Hollerman and W. Schultz, Activity of dopamine neurons during learning in a familiar task context, Soc. Neurosci. Abstr, vol.22, p.1388, 1996.

J. R. Hollerman and W. Schultz, Dopamine neurons report an erron in the temporal prediction of reward during learning, Nature Neuroscience, vol.1, pp.304-309, 1998.

J. Hopfield, Neurons with graded response have collective computational properties like those of two-state neurons., Proceedings of the National Academy of Sciences, vol.81, issue.10, pp.3088-3092, 1984.
DOI : 10.1073/pnas.81.10.3088

M. Isoda and O. Hikosaka, Cortico-basal ganglia mechanisms for overcoming innate, habitual and motivational behaviors, European Journal of Neuroscience, vol.408, issue.11, pp.2058-2069, 2011.
DOI : 10.1111/j.1460-9568.2011.07698.x

M. Ito and K. Doya, Multiple representations and algorithms for reinforcement learning in the cortio-basal ganglia circuit, Current Opinion in Neurobiology, issue.21, pp.368-373, 2011.

D. Joel and I. Weiner, The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum, Neuroscience, vol.96, issue.3, pp.451-474, 2000.
DOI : 10.1016/S0306-4522(99)00575-8

M. S. Jog, Y. Kubota, C. I. Connolly, V. Hillegaart, and A. M. Graybiel, Building Neural Representations of Habits, Science, vol.286, issue.5445, pp.1745-1749, 1999.
DOI : 10.1126/science.286.5445.1745

H. Kita, H. Tokyno, and A. Nambu, Monkey globus pallidus external segment neurons projecting to the neostriatum, NeuroReport, vol.10, issue.7, pp.1476-1472, 1999.
DOI : 10.1097/00001756-199905140-00014

K. S. Lashley, In search of the ngram, Society of experimetnal Biology Symposium, pp.454-480, 1950.

A. Leblois, T. Boraud, W. Meissner, H. Bergman, and D. Hansel, Competition between Feedback Loops Underlies Normal and Pathological Dynamics in the Basal Ganglia, Journal of Neuroscience, vol.26, issue.13, pp.3567-3583, 2006.
DOI : 10.1523/JNEUROSCI.5050-05.2006
URL : https://hal.archives-ouvertes.fr/hal-00094738

G. Leisman, R. Melillo, and F. R. Carrick, Clinical motor and cognitive neurobehavioral relationships in the basal ganglia, basal ganglia -an integrative view, pp.10-5772, 2013.

J. Liénard, Models of the Basal Ganglia: Study of the Functional Anatomy and Pathophysiology using Multiobjective Evolutionary Algorithms, Thèse de doctorat, 2013.

M. Topalidou, B. Liljeholm, M. , O. Doherty, and J. P. , Contributions of the striatum to learning, motivation, and performance: an associative account, Trends in Cognitive Sciences, vol.16, issue.9, pp.467-475, 2012.

T. Ljungberg, P. Apicella, and W. Schultz, Responses of monkey dopamine neurons during learning of behavioral reactions, Journal of Neurophysiology, vol.67, pp.145-163, 1992.

T. V. Maia, R. E. Cooney, and B. S. Peterson, The neural bases of obsessive???compulsive disorder in children and adults, Development and Psychopathology, vol.9, issue.04, pp.1251-1283, 2008.
DOI : 10.1016/j.biopsych.2005.12.012

F. Mannella, K. Gurney, and G. Baldassarre, The nucleus accumbens as a nexus between valus and goals in goal-directed behavior: a review and a new hypothesis, Frontiers in Behavioral Neuroscience, vol.7, issue.135, 2013.

H. Merchant, A. Zainos, A. Hernandez, E. Salinas, and R. Romo, Functional properties of primate putamen neurons during the categorization of tactile stimuli, Journal of Neurophysiology, vol.77, pp.1132-1154, 1997.

J. W. Mink, THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS, Progress in Neurobiology, vol.50, issue.4, pp.381-425, 1996.
DOI : 10.1016/S0301-0082(96)00042-1

. Mink and W. Thach, Basal ganglia intrinsic circuits and their role in behavior, Current Opinion in Neurobiology, vol.3, issue.6, pp.950-957, 1993.
DOI : 10.1016/0959-4388(93)90167-W

J. Mirenowicz and W. Schultz, Importance of unpredictability for reward responses in primate dopamine neurons, J. Neurophysiol, vol.72, pp.1024-1027, 1994.

J. Mirenowicz and W. Schultz, Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli, Nature, vol.379, issue.6564, pp.449-451, 1996.
DOI : 10.1038/379449a0

S. Miyachi, O. Hikosaka, and X. Lu, Differential activation of monkey striatal neurons in the early and late stages of procedural learning, Experimental Brain Research, vol.146, issue.1, pp.122-126, 2002.
DOI : 10.1007/s00221-002-1213-7

S. Miyachi, O. Hikosaka, K. Miyashita, Z. Kárádi, and M. K. Rand, Differential roles of monkey striatum in learning of sequential hand movement, Experimental Brain Research, vol.115, issue.1, pp.1-5, 1997.
DOI : 10.1007/PL00005669

P. R. Montague, P. Dayan, and T. J. Sejnowski, A framework for mesencephalic dopamine systems based on predictive hebbian learning, Journal of Neuroscience, vol.16, pp.1936-1947, 1996.

E. Moro, A. E. Lang, A. P. Strafella, Y. W. Poon, P. M. Arango et al., Bilateral globus pallidus stimulation for Huntington's disease, Annals of Neurology, vol.111, issue.2, pp.290-294, 2004.
DOI : 10.1002/ana.20183

A. A. Moustafa, I. Bar-gad, A. Korngreen, and H. Bergman, Basal ganglia: physiological and behavioral and and computational studies, Frontiers in Systems Neuroscience, vol.8, issue.150, 2014.

A. Nadjar, J. M. Brotchie, C. Guigoni, Q. L. Zhou, . S-b et al., Phenotype of Striatofugal Medium Spiny Neurons in Parkinsonian and Dyskinetic Nonhuman Primates: A Call for a Reappraisal of the Functional Organization of the Basal Ganglia, Journal of Neuroscience, vol.26, issue.34, pp.8653-8661, 2006.
DOI : 10.1523/JNEUROSCI.2582-06.2006

K. Nakano, Neural circuits and topographic organization of the basal ganglia and related regions, Brain and Development, vol.22, pp.5-16, 2000.
DOI : 10.1016/S0387-7604(00)00139-X

A. Nambu, H. Tokuno, I. Hamada, H. Kita, M. Imanishi et al., b. Excitatory cortical inputs to pallidal neurons via the subthalamic nucleus in the monkey, Journal of Neurobiology, vol.84, p.289, 2000.

M. Topalidou, B. Nambu, A. Tokuno, H. Takada, and M. , Functional significance of the cortico /subthalamo /pallidal 'hyperdirect' pathway, Neuroscience Research, vol.43, pp.111-117, 2002.

E. Nisenbaum and C. Wilson, Potassium currents responsible for inward and outward rectification in rat neostriatal spiny projection neurons, J Neurosci, vol.15, pp.4449-4463, 1995.

Y. Niv, D. Joel, and P. Dayan, A normative perspective on motivation, Congitivie Sciences, pp.375-381, 2006.
DOI : 10.1016/j.tics.2006.06.010

E. Nordlie, M. Gewaltig, and H. E. Plesser, Towards Reproducible Descriptions of Neuronal Network Models, PLoS Computational Biology, vol.367, issue.8, 2009.
DOI : 10.1371/journal.pcbi.1000456.s003

M. G. Packard, Exhumed from thought: Basal ganglia and response learning in the plus-maze, Behavioural Brain Research, vol.199, issue.1, pp.24-31, 2009.
DOI : 10.1016/j.bbr.2008.12.013

A. Parent and L. Hazrati, Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop, Brain Research Reviews, vol.20, issue.1, pp.91-127, 1995.
DOI : 10.1016/0165-0173(94)00007-C

A. Parent and L. Hazrati, Functional anatomy of the basal ganglia. II. The place of subthalamic nucleus and external pallidium in basal ganglia circuitry, Brain Research Reviews, vol.20, issue.1, pp.128-154, 1995.
DOI : 10.1016/0165-0173(94)00008-D

A. Parent, F. Sato, Y. Wu, J. Gauthier, M. Levesque et al., Organization of the basal ganglia: the importance of axonal collateralization, Trends in Neurosciences, vol.23, pp.20-27, 2000.
DOI : 10.1016/S1471-1931(00)00022-7

A. Paspathy and E. Miller, Different time courses of learning-related activity in the prefrontal cortex and striatum, Nature, vol.16, issue.7028, pp.873-876, 2005.
DOI : 10.1126/science.274.5286.427

B. Pasquereau, A. Nadjar, D. Arkadir, E. Bezard, M. Goillandeau et al., Shaping of Motor Responses by Incentive Values through the Basal Ganglia, Journal of Neuroscience, vol.27, issue.5, pp.1176-1183, 2007.
DOI : 10.1523/JNEUROSCI.3745-06.2007

I. Pavlov, Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex, Annals of neurosciences, vol.17, issue.3, 1927.
DOI : 10.5214/ans.0972-7531.1017309

V. Pawlak and J. Kerr, Dopamine Receptor Activation Is Required for Corticostriatal Spike-Timing-Dependent Plasticity, Journal of Neuroscience, vol.28, issue.10, pp.2435-2446, 2008.
DOI : 10.1523/JNEUROSCI.4402-07.2008
URL : http://hdl.handle.net/11858/00-001M-0000-0013-CA15-5

G. Pezzulo, P. F. Verschure, C. Balkenius, and C. M. Pennartz, The principles of goal-directed decision-making: from neural mechanisms to computation and robotics, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.369, issue.1655, 2014.
DOI : 10.1098/rstb.2013.0486

C. Piron, D. Kase, M. Topalidou, M. Goillandeau, H. Orignac et al., The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox, Movement Disorders, vol.220, issue.8, 2016.
DOI : 10.1016/j.expneurol.2009.08.030
URL : https://hal.archives-ouvertes.fr/hal-01317968

T. J. Prescott, F. Montes-gonzalez, K. Gurney, M. D. Humphries, and P. Redgrave, A robot model of the basal ganglia: Behavior and intrinsic processing, Neural Networks, vol.19, issue.1, pp.31-61, 2006.
DOI : 10.1016/j.neunet.2005.06.049

T. J. Prescott, P. Redgrave, and K. Gurney, Layered Control Architectures in Robots and Vertebrates, Adaptive Behavior, vol.7, issue.1, pp.99-127, 1999.
DOI : 10.1177/105971239900700105
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.32.4761

P. Redgrave, T. J. Prescott, and K. Gurney, Basal ganglia, Scholarpedia, vol.2, issue.6, pp.1009-1023, 1999.
DOI : 10.4249/scholarpedia.1825
URL : https://hal.archives-ouvertes.fr/inserm-00410943

P. Redgrave, M. Rodriguez, Y. Smith, M. C. Rodriguez-oroz, S. Lehericy et al., Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease, Nature Reviews Neuroscience, vol.26, issue.11, pp.760-772, 2010.
DOI : 10.1038/nrn2915

M. Topalidou, B. Reiner, A. Hart, N. M. Lei, W. Deng et al., Corticostriatal projection neurons?dichotomous types and dichotomous functions, Frontiers in Neuroanatomy, vol.4, issue.142, 2010.

J. N. Reynolds and J. R. Wickens, Dopamine-dependent plasticity of corticostriatal synapses, Neural Networks, vol.15, issue.4-6, pp.507-521, 2002.
DOI : 10.1016/S0893-6080(02)00045-X

M. J. Robinson and K. C. Berridge, Instant Transformation of Learned Repulsion into Motivational ???Wanting???, Current Biology, vol.23, issue.4, pp.282-289, 2013.
DOI : 10.1016/j.cub.2013.01.016

R. Romo, H. Merchant, and A. Hernandez, Categorical perception of somesthetic stimuli: psychophysical measurements correlated with neuronal events in primate medial premotor cortex, Cerebral Cortex, vol.7, issue.4, pp.317-326, 1997.
DOI : 10.1093/cercor/7.4.317

R. Romo, H. Merchant, S. Ruiz, P. Crespo, and A. Zainos, Neuronal activity of primate putamen during categorical perception of somaesthetic stimuli, NeuroReport, vol.6, issue.7, pp.1013-1017, 1995.
DOI : 10.1097/00001756-199505090-00016

R. Romo and W. Schultz, Dopamine neurons of hte monkey midbrain: contingencies of responses to active touch during selfinitiated arm movements, J. Neurophysiol, vol.63, pp.592-606, 1990.

P. H. Rudebeck, T. E. Behrens, S. W. Kennerley, M. G. Baxter, M. J. Buckey et al., Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli, Journal of Neuroscience, vol.28, issue.51, pp.13775-13788, 2008.
DOI : 10.1523/JNEUROSCI.3541-08.2008

M. Sandstorm and G. Rebec, Characterization of striatal activity in conscious rats: Contribution of NMDA and AMPA/kainate receptors to both spontaneous and glutamate-driven firing, Synapse, vol.877, issue.2, pp.91-100, 2003.
DOI : 10.1002/syn.10142

R. M. Schneider and W. Shiffrin, Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory, journal = Psychol. Rev, vol.84, pp.127-190, 1993.

H. Schroll and F. H. Hamker, Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy, Frontiers in Systems Neuroscience, vol.7, issue.122, 2013.
DOI : 10.3389/fnsys.2013.00122

W. Schultz, Predictive reward signal of dopamine neurons, Journal of Neurophysiology, vol.80, pp.1-27, 1998.

W. Schultz, Getting Formal with Dopamine and Reward, Neuron, vol.36, issue.2, pp.241-263, 2002.
DOI : 10.1016/S0896-6273(02)00967-4
URL : http://doi.org/10.1016/s0896-6273(02)00967-4

W. Schultz, Neuronal Reward and Decision Signals: From Theories to Data, Physiological Reviews, vol.95, issue.3, pp.853-951, 2015.
DOI : 10.1152/physrev.00023.2014
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4491543

W. Schultz, P. Dayan, and P. R. Montague, A Neural Substrate of Prediction and Reward, Science, vol.263, issue.5149, pp.1593-1599, 1997.
DOI : 10.1126/science.7508638

S. C. Sealfon and C. W. Olanow, Dopamine receptors: from structure to behavior, Trends in Neurosciences, vol.23, 2000.
DOI : 10.1016/S1471-1931(00)00025-2

J. K. Seamans and T. W. Robbins, Dopamine modulation of prefrontal cortex and cognitive function The dopamine receptors, pp.373-398, 2009.

C. A. Seger, Implicit learning., Psychological Bulletin, vol.115, issue.2, pp.163-196, 1994.
DOI : 10.1037/0033-2909.115.2.163

C. A. Seger, How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback, Neuroscience & Biobehavioral Reviews, vol.32, issue.2, pp.265-278, 2008.
DOI : 10.1016/j.neubiorev.2007.07.010

C. A. Seger and B. J. Spiering, A Critical Review of Habit Learning and the Basal Ganglia, Frontiers in Systems Neuroscience, vol.5, issue.66, 2011.
DOI : 10.3389/fnsys.2011.00066

M. Topalidou, B. Shepherd, and G. M. , Corticostriatal connectivity and its role in disease, Nature Rievews, Neuroscience, vol.14, pp.278-291, 2013.

C. S. Sherrington, Observations on the scratch-reflex in the spinal dog, The Journal of Physiology, vol.34, issue.1-2, pp.1-50, 1906.
DOI : 10.1113/jphysiol.1906.sp001139

W. Shiffrin and R. M. Schneider, Controlled and automatic human information processing: 1. detection search, and attention, Psychol. Rev, vol.84, pp.1-66, 1977.

O. Shriki, D. Hasel, and H. Sompolinsky, Rate Models for Conductance-Based Cortical Neuronal Networks, Neural Computation, vol.16, issue.8, pp.1809-1841, 2003.
DOI : 10.1016/S0006-3495(72)86068-5
URL : https://hal.archives-ouvertes.fr/hal-00173803

B. F. Skinner, Are theories of learning necessary?, Psychological Review, vol.57, issue.4, pp.193-216, 1950.
DOI : 10.1037/h0054367

L. R. Squire and S. Zola-morgan, The medial temporal lobe memory system, Science, vol.250, issue.4978, pp.1380-1386, 1991.
DOI : 10.1126/science.2218534

L. R. Squire and S. Zola-morgan, Memory: brain systems and behavior, Trends in Neurosciences, vol.11, issue.4, pp.170-175, 1988.
DOI : 10.1016/0166-2236(88)90144-0

W. Staines, S. Atmadja, and H. Fibiger, Demonstration of a pallidostriatal pathway by retrograde transport of HRP-labeled lectin, Brain Research, vol.206, issue.2, pp.446-450, 1981.
DOI : 10.1016/0006-8993(81)90545-X

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

J. M. Tepper and J. P. Bolam, Functional diversity and specificity of neostriatal interneurons, Current Opinion in Neurobiology, vol.14, issue.6, pp.685-692, 2008.
DOI : 10.1016/j.conb.2004.10.003

E. L. Thorndike, Animal intelligence: An experimental study of the associative processes in animals, Psychological Monographs: General and Applied, pp.277-293, 1898.

E. C. Bibliography-tolman, Cognitive maps in rats and men., Psychological Review, vol.55, issue.4, pp.189-208, 1948.
DOI : 10.1037/h0061626

M. Topalidou, D. Kase, T. Boraud, and N. P. Rougier, Dissociation of reinforcement and hebbian learning induces covert acquisition of values in the basal ganglia, In: BioRxiv preprint, 2016.

M. Topalidou, A. Leblois, T. Boraud, and N. P. Rougier, A long journey into reproducible computational neuroscience, Frontiers in Computational Neuroscience, vol.515, issue.30, 2015.
DOI : 10.1038/515151a
URL : https://hal.archives-ouvertes.fr/hal-01109483

M. Topalidou and N. P. Rougier, [re] interaction between cognintive and motor cortico-basal ganglia loops during decision making: a computational study, ReScience, vol.1, issue.1, 2015.

A. A. Utter and M. A. Basso, The basal ganglia: An overview of circuits and function, Neuroscience & Biobehavioral Reviews, vol.32, issue.3, pp.333-342, 2008.
DOI : 10.1016/j.neubiorev.2006.11.003

M. A. Van-der-meer and D. A. Redish, Expectancies in decision making, reinforcement learning, and ventral striatum, Frontiers in Neuroscience, vol.4, issue.1, pp.29-37, 2010.
DOI : 10.3389/neuro.01.006.2010

K. S. Wang, J. P. Mcclure, . Jr, S. K. Alselehdar, and V. Kanta, Direct and indirect pathways of the basal ganglia: opponents or collaborators? Frontiers in Neuroanatomy, 2015.

E. Wendler, J. C. Gaspar, T. L. Ferreira, J. K. Barbiero, R. Andereatini et al., The roles of the nucleus accumbens core, dorsomedial striatum, and dorsolateral striatum in learning: Performance and extinction of Pavlovian fear-conditioned responses and instrumental avoidance responses, Neurobiology of Learning and Memory, vol.109, 2013.
DOI : 10.1016/j.nlm.2013.11.009

J. Wickens, Striatal dopamine in motor activation and reward-mediated learning: steps towards a unifying model, Journal of Neural Transmission, vol.139, issue.1, pp.9-31, 1990.
DOI : 10.1007/BF01245020

J. Wickens, A theory of the striatum, 1993.

J. Wickens, Basal ganglia: structure and computations, Network: Computation in Neural Systems, vol.8, issue.4, pp.77-109, 1997.
DOI : 10.1088/0954-898X_8_4_001

J. R. Wickens, Synaptic plasticity in the basal ganglia, Behavioural Brain Research, vol.199, issue.1, pp.119-128, 2009.
DOI : 10.1016/j.bbr.2008.10.030

C. Wilson and P. Groves, Spontaneous firing patterns of identified spiny neurons in the rat neostriatum, Brain Research, vol.220, issue.1, pp.67-80, 1981.
DOI : 10.1016/0006-8993(81)90211-0

H. R. Wilson and J. D. Cowan, Excitatory and Inhibitory Interactions in Localized Populations of Model Neurons, Biophysical Journal, vol.12, issue.1, pp.1-24, 1972.
DOI : 10.1016/S0006-3495(72)86068-5

H. Yin, S. B. Ostlund, B. J. Knowlton, and B. W. Balleine, The role of the dorsomedial striatum in instrumental conditioning, European Journal of Neuroscience, vol.22, issue.2, pp.513-523, 2005.
DOI : 10.1111/j.1460-9568.2005.04218.x

H. H. Yin, From action to habits: Neuroadaptations leading to dependence, Alcohol Res Health, vol.31, issue.4, pp.340-344, 2008.

H. H. Yin and B. J. Knowlton, The role of the basal ganglia in habit formation, Nature Reviews Neuroscience, vol.9, issue.6, pp.464-476, 2006.
DOI : 10.1038/nrn1919

H. H. Yin, B. J. Knowlton, and B. W. Balleine, Lesions of dorsolateral striatum preserve outcome expectancy but disrupt From goal-directed actions to habits, 2004.