G. E. Alexander, M. D. Crutcher, and M. R. Delong, Chapter 6 Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, ???prefrontal??? and ???limbic??? functions, Progress in Brain Research, vol.85, pp.119-146, 1990.
DOI : 10.1016/S0079-6123(08)62678-3

G. E. Alexander, M. R. Delong, S. , and P. L. , Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and Cortex, Annual Review of Neuroscience, vol.9, issue.1, pp.357-381, 1986.
DOI : 10.1146/annurev.ne.09.030186.002041

M. Bevan, P. Booth, S. Eaton, and J. Bolam, Selective innervation of neostriatal interneurons by a subclass of neurons in the globus pallidus of rats, Journal of Neuroscience, issue.22, pp.189438-9452, 1998.

G. Chevalier and M. Deniau, Disinhibition as a basic process in the expression of striatal functions, Trends in Neurosciences, vol.13, issue.7, pp.277-280, 1990.
DOI : 10.1016/0166-2236(90)90109-N

P. Dayan, Motivated reinforcement learning, Neural Information Processing Systems, 2001.

P. Dayan and L. Abbott, Theoretical neuroscience: computational and mathematical modeling of neural systems, 2001.

M. Delong, A. Georgopoulos, M. Crutcher, S. Mitchell, R. Richardson et al., Functional Organization of the Basal Ganglia: Contributions of Single-Cell Recording Studies, Ciba Foundation Symposium, vol.2, pp.64-82, 1984.
DOI : 10.1002/9780470720882.ch5

J. Deniau, S. Kitai, J. Donoghue, and I. Grofova, Neuronal interactions in the substancia nigra pars reticulata through axon collateral of the projection neurons, Experimental Brain Research, vol.47, pp.105-113, 1982.

P. Dupuis and A. Nagurney, Dynamical systems and variational inequalities, Annals of Operations Research, vol.17, issue.1, pp.7-42, 1993.
DOI : 10.1007/BF02073589

A. Filippov, Differential equations with many-valued discontinuous righthand side, Soviet Math, vol.4, pp.941-945, 1963.
DOI : 10.1007/978-94-015-7793-9

M. Frank, A. Santamaria, R. O-'reilly, and E. Willcutt, Testing Computational Models of Dopamine and Noradrenaline Dysfunction in Attention Deficit/Hyperactivity Disorder, Neuropsychopharmacology, vol.26, issue.7, pp.1583-1599, 2007.
DOI : 10.1038/sj.npp.1301278

B. Gerkey, R. Vaughan, and A. Howard, The Player/Stage project: Tools for multi-robot and distributed sensor systems, 11th International Conference on Advanced Robotics, pp.317-323, 2003.

A. Gillies and G. Arbruthnott, Computational models of the basal ganglia, Movement Disorders, vol.265, issue.5, pp.762-770, 2000.
DOI : 10.1002/1531-8257(200009)15:5<762::AID-MDS1002>3.0.CO;2-2

B. Girard, V. Cuzin, A. Guillot, K. N. Gurney, P. et al., A BASAL GANGLIA INSPIRED MODEL OF ACTION SELECTION EVALUATED IN A ROBOTIC SURVIVAL TASK, Journal of Integrative Neuroscience, vol.80, issue.02, pp.179-200, 2003.
DOI : 10.1163/156853971X00258

URL : https://hal.archives-ouvertes.fr/hal-00016392

B. Girard, D. Filliat, J. Meyer, A. Berthoz, and A. Guillot, Integration of Navigation and Action Selection Functionalities in a Computational Model of Cortico-Basal-Ganglia-Thalamo-Cortical Loops, Adaptive Behavior, vol.13, issue.2, pp.115-130, 2005.
DOI : 10.1177/105971230501300204

URL : https://hal.archives-ouvertes.fr/hal-00016389

B. Girard, N. Tabareau, A. Berthoz, and J. Slotine, Selective amplification using a contracting model of the basal ganglia, pp.30-33, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00111145

B. Girard, N. Tabareau, J. Slotine, and A. Berthoz, Contracting model of the basal ganglia, Modelling Natural Action Selection: Proceedings of an International Workshop, pp.69-76, 2005.
URL : https://hal.archives-ouvertes.fr/hal-00016414

K. Gurney, M. Humphries, R. Wood, T. Prescott, R. et al., Testing computational hypotheses of brain systems function: a case study with the basal ganglia, Network: Computation in Neural Systems, vol.15, issue.4, pp.263-290, 2004.
DOI : 10.1088/0954-898X_15_4_003

K. Gurney, T. Prescott, J. Wickens, R. , and P. , Computational models of the basal ganglia: from robots to membranes, Trends in Neurosciences, vol.27, issue.8, pp.453-459, 2004.
DOI : 10.1016/j.tins.2004.06.003

K. Gurney, T. J. Prescott, R. , and P. , A computational model of action selection in the basal ganglia. I. A new functional anatomy, Biological Cybernetics, vol.84, issue.6, pp.401-410, 2001.
DOI : 10.1007/PL00007984

K. Gurney, T. J. Prescott, R. , and P. , A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour, Biological Cybernetics, vol.84, issue.6, pp.411-423, 2001.
DOI : 10.1007/PL00007985

R. Horn and C. Johnson, Matrix Analysis, 1985.

J. C. Houk, J. L. Adams, and A. G. Barto, A model of how the basal ganglia generate and use neural signals that predict reinforcement, Models of Information Processing in the Basal Ganglia, pp.249-271, 1995.

M. Humphries, K. Gurney, P. , and T. , Is There an Integrative Center in the Vertebrate Brain-Stem? A Robotic Evaluation of a Model of the Reticular Formation Viewed as an Action Selection Device, Adaptive Behavior, vol.13, issue.2, pp.97-113, 2005.
DOI : 10.1177/105971230501300203

P. Ioannou and J. Sun, Robust Adaptive Control, 1996.
DOI : 10.1201/b10384-41

URL : https://hal.archives-ouvertes.fr/hal-01394197

D. Joel, Y. Niv, and E. And-ruppin, Actor???critic models of the basal ganglia: new anatomical and computational perspectives, Neural Networks, vol.15, issue.4-6, pp.4-6, 2002.
DOI : 10.1016/S0893-6080(02)00047-3

J. Juraska, C. Wilson, and P. Groves, The substantia nigra of the rat: A golgi study, The Journal of Comparative Neurology, vol.185, issue.4, pp.585-600, 1977.
DOI : 10.1002/cne.901720403

M. Khamassi, B. Girard, A. Berthoz, and A. Guillot, Comparing three critic models of reinforcement learning in the basal ganglia connected to a detailed actor part in a s-r task, Proceedings of the Eighth International Conference on Intelligent Autonomous Systems (IAS8), pp.430-437, 2004.

M. Khamassi, L. Lachèze, B. Girard, A. Berthoz, and A. Guillot, Actor-Critic Models of Reinforcement Learning in the Basal Ganglia: From Natural to Artificial Rats, Adaptive Behavior, vol.13, issue.2, pp.131-148, 2005.
DOI : 10.1177/105971230501300205

URL : https://hal.archives-ouvertes.fr/hal-00016390

A. Kimura and A. Graybiel, Functions of the Cortico-Basal Ganglia Loop, 1995.
DOI : 10.1007/978-4-431-68547-0

H. Kita, H. Tokuno, and A. Nambu, Monkey globus pallidus external segment neurons projecting to the neostriatum, NeuroReport, vol.10, issue.7, pp.1476-1472, 1999.
DOI : 10.1097/00001756-199905140-00014

G. Konidaris, A. S. Barto, G. Baldassarre, R. Calabretta, J. Hallam et al., An Adaptive Robot Motivational System, From Animals to Animats 9: Proceedings of the 9th International Conference on the Simulation of Adaptive Behavior, pp.346-356, 2006.
DOI : 10.1007/11840541_29

URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=

J. Krotopov and S. Etlinger, Selection of actions in the basal ganglia???thalamocortical circuits: review and model, International Journal of Psychophysiology, vol.31, issue.3, pp.197-217, 1999.
DOI : 10.1016/S0167-8760(98)00051-8

W. Lohmiller and J. Slotine, On Contraction Analysis for Non-linear Systems, Automatica, vol.34, issue.6, pp.683-696, 1998.
DOI : 10.1016/S0005-1098(98)00019-3

W. Lohmiller and J. Slotine, Nonlinear process control using contraction theory, AIChE Journal, vol.30, issue.3, pp.588-596, 2000.
DOI : 10.1002/aic.690460317

F. A. Middleton and P. L. Strick, Anatomical evidence for cerebellar and basal ganglia involvement in higher cognitive function, Science, vol.266, issue.5184, pp.458-461, 1994.
DOI : 10.1126/science.7939688

J. W. Mink, THE BASAL GANGLIA: FOCUSED SELECTION AND INHIBITION OF COMPETING MOTOR PROGRAMS, Progress in Neurobiology, vol.50, issue.4, pp.381-425, 1996.
DOI : 10.1016/S0301-0082(96)00042-1

F. Montes-gonzalez, T. J. Prescott, K. N. Gurney, M. Humphries, R. et al., An embodied model of action selection mechanisms in the vertebrate brain, From Animals to Animats 6, pp.157-166, 2000.

M. Park, W. Falls, and S. Kitai, An intracellular HRP study of the rat globus pallidus. I. Responses and light microscopic analysis, The Journal of Comparative Neurology, vol.15, issue.3, pp.284-294, 1982.
DOI : 10.1002/cne.902110307

P. Pirjanian, Behavior coordination mechanisms ? state-of-the-art, 1999.

T. J. Prescott, F. Montes-gonzalez, K. Gurney, M. D. Humphries, R. et al., A robot model of the basal ganglia: Behavior and intrinsic processing, Neural Networks, vol.19, issue.1, pp.31-61, 2006.
DOI : 10.1016/j.neunet.2005.06.049

P. Redgrave, T. J. Prescott, and K. Gurney, The basal ganglia: a vertebrate solution to the selection problem?, Neuroscience, vol.89, issue.4, pp.1009-1023, 1999.
DOI : 10.1016/S0306-4522(98)00319-4

F. Sato, P. Lavallee, M. Lévesque, and A. Parent, Single-axon tracing study of neurons of the external segment of the globus pallidus in primate, The Journal of Comparative Neurology, vol.227, issue.1, pp.17-31, 2000.
DOI : 10.1002/(SICI)1096-9861(20000131)417:1<17::AID-CNE2>3.0.CO;2-I

J. Slotine and J. Coetsee, Adaptive sliding controller synthesis for non-linear systems, International Journal of Control, vol.10, issue.6, pp.1631-1651, 1986.
DOI : 10.1109/TAC.1977.1101446

J. J. Slotine and W. Lohmiller, Modularity, evolution, and the binding problem: a view from stability theory, Neural Networks, vol.14, issue.2, pp.137-145, 2001.
DOI : 10.1016/S0893-6080(00)00089-7

W. Staines, S. Atmadja, and H. Fibiger, Demonstration of a pallidostriatal pathway by retrograde transport of HRP-labeled lectin, Brain Research, vol.206, issue.2, pp.446-450, 1981.
DOI : 10.1016/0006-8993(81)90545-X

N. Tabareau and J. Slotine, Notes on Contraction Theory. Arxiv preprint nlin, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00016453

J. Tepper and J. Bolam, Functional diversity and specificity of neostriatal interneurons, Current Opinion in Neurobiology, vol.14, issue.6, pp.685-692, 2004.
DOI : 10.1016/j.conb.2004.10.003

J. Tepper, T. Koós, W. , and C. , GABAergic microcircuits in the neostriatum, Trends in Neurosciences, vol.27, issue.11, pp.662-669, 2004.
DOI : 10.1016/j.tins.2004.08.007

T. Tyrrell, The Use of Hierarchies for Action Selection, Adaptive Behavior, vol.1, issue.4, pp.387-420, 1993.
DOI : 10.1177/105971239300100401

Y. Wu, S. Richard, and A. Parent, The organization of the striatal output system: a single-cell juxtacellular labeling study in the rat, Neuroscience Research, vol.38, issue.1, pp.49-62, 2000.
DOI : 10.1016/S0168-0102(00)00140-1

D. Zhang and A. Nagurney, On the stability of projected dynamical systems, Journal of Optimization Theory and Applications, vol.32, issue.1, pp.97-124, 1995.
DOI : 10.1007/BF02192301

. B. Fig, Potential Energy consumption rate These histograms represent the average E p consumption rate computed for each trial. Top: BG model; bottom: ITE; the dashed line shows the Energy consumption rate of all actions except Rest