R. Albin, A. Young, and J. Penney, The functional anatomy of basal ganglia disorders, Trends in Neurosciences, vol.12, issue.10, pp.366-375, 1989.
DOI : 10.1016/0166-2236(89)90074-X

G. Alexander and M. Crutcher, Preparation for movement: neural representations of intended direction in three motor areas of the monkey, J Neurophysiol, 1990.

G. Alexander, M. Delong, and P. Strick, Parallel Organization of Functionally Segregated Circuits Linking Basal Ganglia and Cortex, Annual Review of Neuroscience, vol.9, issue.1, pp.357-381, 1986.
DOI : 10.1146/annurev.ne.09.030186.002041

J. Charlesworth, T. Warren, and M. Brainard, Covert skill learning in a cortical-basal ganglia circuit, Nature, vol.21, pp.251-255, 2012.
DOI : 10.1038/nature11078
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3377745

B. Doll, D. Simon, and N. Daw, The ubiquity of model-based reinforcement learning, Current Opinion in Neurobiology, vol.22, issue.6, pp.1075-1081, 2012.
DOI : 10.1016/j.conb.2012.08.003

K. Doya, Complementary roles of basal ganglia and cerebellum in learning and motor control, Current Opinion in Neurobiology, vol.10, issue.6, pp.732-739, 2000.
DOI : 10.1016/S0959-4388(00)00153-7

K. Doya, Reinforcement learning: Computational theory and biological mechanisms, HFSP Journal, vol.1, issue.1, pp.30-41, 2007.
DOI : 10.2976/1.2732246/10.2976/1
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2645553

P. Glimcher, Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis, Proceedings of the National Academy of Sciences, vol.10, issue.12, pp.15647-15654, 2011.
DOI : 10.1038/nrn2753
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3176615

M. Guthrie, A. Leblois, A. Garenne, and T. Boraud, Interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study, Journal of Neurophysiology, vol.109, issue.12, pp.3025-3040, 2013.
DOI : 10.1152/jn.00026.2013
URL : https://hal.archives-ouvertes.fr/hal-00828004

D. Kase and T. Boraud, Covert learning in the basal ganglia: raw data Available at: https://figshare, p.7, 2017.

A. Leblois, T. Boraud, and W. Meissner, Competition between Feedback Loops Underlies Normal and Pathological Dynamics in the Basal Ganglia, Journal of Neuroscience, vol.26, issue.13, pp.3567-3583, 2006.
DOI : 10.1523/JNEUROSCI.5050-05.2006
URL : https://hal.archives-ouvertes.fr/hal-00094738

Y. Niv and A. Langdon, Reinforcement learning with Marr, Current Opinion in Behavioral Sciences, vol.11, pp.67-73, 2016.
DOI : 10.1016/j.cobeha.2016.04.005

A. Parent and L. Hazrati, Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop, Brain Research Reviews, vol.20, issue.1, pp.91-127, 1995.
DOI : 10.1016/0165-0173(94)00007-C

A. Pasupathy and E. Miller, Different time courses of learning-related activity in the prefrontal cortex and striatum, Nature, vol.16, issue.7028, pp.873-876, 2005.
DOI : 10.1126/science.274.5286.427

C. Piron, D. Kase, M. Topalidou, M. Goillandeau, H. Orignac et al., The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox, Movement Disorders, vol.220, issue.8, pp.1-9, 2016.
DOI : 10.1016/j.expneurol.2009.08.030
URL : https://hal.archives-ouvertes.fr/hal-01317968

T. Pohlert, The Pairwise Multiple Comparison of Mean Ranks Package (PMCMR) R package version 1.0. h ttp, 2014.

P. Redgrave, K. Gurney, and J. Reynolds, What is reinforced by phasic dopamine signals?, Brain Research Reviews, vol.58, issue.2, pp.322-339, 2008.
DOI : 10.1016/j.brainresrev.2007.10.007

N. Rougier, Covert learning in the basal ganglia: figures. FigShare. Available at: https://figshare, p.4753597, 2017.

N. Rougier and M. Topalidou, Covert learning in the basal ganglia: code. Available at: https://github.com/rougier/one-critic-two-actors, 2017.

R. Suri, TD models of reward predictive responses in dopamine neurons, Neural Networks, vol.15, issue.4-6, pp.523-533, 2002.
DOI : 10.1016/S0893-6080(02)00046-1

R. Suri and W. Schultz, A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task, Neuroscience, vol.91, issue.3, pp.871-890, 1999.
DOI : 10.1016/S0306-4522(98)00697-6
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.11.2343

R. Sutton and A. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

R. Turner and M. Desmurget, Basal ganglia contributions to motor control: a vigorous tutor, Current Opinion in Neurobiology, vol.20, issue.6, pp.1-13, 2014.
DOI : 10.1016/j.conb.2010.08.022
URL : http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3025075