J. R. Anderson, D. Bothell, M. D. Byrne, S. Douglass, C. Lebiere et al., An Integrated Theory of the Mind., Psychological Review, vol.111, issue.4, pp.1036-1060, 2004.
DOI : 10.1037/0033-295X.111.4.1036

G. Aston-jones, J. Rajkowski, and P. Kubiak, Conditioned responses of monkey locus coeruleus neurons anticipate acquisition of discriminative behavior in a vigilance task, Neuroscience, vol.80, issue.3, pp.697-715, 1997.
DOI : 10.1016/S0306-4522(97)00060-2

G. Aston-jones and J. D. Cohen, AN INTEGRATIVE THEORY OF LOCUS COERULEUS-NOREPINEPHRINE FUNCTION: Adaptive Gain and Optimal Performance, Annual Review of Neuroscience, vol.28, issue.1, pp.403-450, 2005.
DOI : 10.1146/annurev.neuro.28.061604.135709

G. Aston-jones, J. Rajkowski, and J. Cohen, Role of locus coeruleus in attention and behavioral flexibility, Biological Psychiatry, vol.46, issue.9, pp.1309-1320, 1999.
DOI : 10.1016/S0006-3223(99)00140-7

P. P. Balasubramani, V. S. Chakravarthy, B. Ravindran, and A. A. Moustafa, An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction, and punishment learning, Frontiers in Computational Neuroscience, vol.276, 2014.
DOI : 10.1098/rspb.2009.1312

O. Berger-tal, J. Nathan, E. Meron, and D. Saltz, The Exploration-Exploitation Dilemma: A Multidisciplinary Framework, PLoS ONE, vol.14, issue.4, pp.1-8, 2014.
DOI : 10.1371/journal.pone.0095693.t001

K. C. Berridge and T. E. Robinson, What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?, Brain Research Reviews, vol.28, issue.3, pp.309-369, 1998.
DOI : 10.1016/S0165-0173(98)00019-8

S. Bouret and S. J. Sara, Network reset: a simplified overarching theory of locus coeruleus noradrenaline function, Trends in Neurosciences, vol.28, issue.11, pp.574-582, 2005.
DOI : 10.1016/j.tins.2005.09.002
URL : https://hal.archives-ouvertes.fr/hal-00088131

L. Calandreau, P. Trifilieff, N. Mons, L. Costes, M. Marien et al., Extracellular Hippocampal Acetylcholine Level Controls Amygdala Function and Promotes Adaptive Conditioned Emotional Response, Journal of Neuroscience, vol.26, issue.52, pp.13556-13566, 2006.
DOI : 10.1523/JNEUROSCI.3713-06.2006

M. Carrere and F. Alexandre, A pavlovian model of the amygdala and its influence within the medial temporal lobe, Frontiers in Systems Neuroscience, vol.46, issue.129, 2015.
DOI : 10.1016/j.neuron.2005.04.026
URL : https://hal.archives-ouvertes.fr/hal-01145790

J. D. Cohen, S. M. Mcclure, and A. J. Yu, Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration, Philosophical Transactions of the Royal Society B: Biological Sciences, vol.46, issue.4, pp.933-942, 1481.
DOI : 10.1037/0033-295X.111.4.939

R. Cools, K. Nakamura, and N. D. Daw, Serotonin and Dopamine: Unifying Affective, Activational, and Decision Functions, Neuropsychopharmacology, vol.367, issue.1, pp.98-113, 2011.
DOI : 10.1126/science.1167342

N. D. Daw, S. Kakade, and P. Dayan, Opponent interactions between serotonin and dopamine, Neural Networks, vol.15, issue.4-6, pp.603-616, 2002.
DOI : 10.1016/S0893-6080(02)00052-7

N. D. Daw, J. P. O-'doherty, P. Dayan, B. Seymour, and R. J. Dolan, Cortical substrates for exploratory decisions in humans, Nature, vol.15, issue.7095, pp.876-879, 2006.
DOI : 10.1038/nature04766

P. Dayan, Twenty-Five Lessons from Computational Neuromodulation, Neuron, vol.76, issue.1, pp.240-256, 2012.
DOI : 10.1016/j.neuron.2012.09.027

K. Doya, Metalearning and neuromodulation, Neural Networks, vol.15, issue.4-6, pp.4-6, 2002.
DOI : 10.1016/S0893-6080(02)00044-8

K. Doya, K. Samejima, K. I. Katagiri, and M. Kawato, Multiple Model-Based Reinforcement Learning, Neural Computation, vol.3, issue.6, pp.1347-1369, 1347.
DOI : 10.1016/S1364-6613(98)01221-2

K. Friston, Functional integration and inference in the brain, Progress in Neurobiology, vol.68, issue.2, pp.113-143, 2002.
DOI : 10.1016/S0301-0082(02)00076-X

S. Grossberg, Adaptive Resonance Theory: How a brain learns to consciously attend, learn, and recognize a changing world, Neural Networks, vol.37, pp.1-47, 2013.
DOI : 10.1016/j.neunet.2012.09.017

S. Haber, J. Fudge, and N. Mcfarland, Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum, The Journal of Neuroscience, vol.20, issue.6, pp.2369-2382, 2000.

M. D. Humphries, M. Khamassi, and K. Gurney, Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia, Frontiers in Neuroscience, vol.6, issue.9, 2012.
DOI : 10.3389/fnins.2012.00009
URL : https://hal.archives-ouvertes.fr/hal-00688928

F. Mannella, K. Gurney, and G. Baldassarre, The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis, Frontiers in Behavioral Neuroscience, vol.7, 2013.
DOI : 10.3389/fnbeh.2013.00135

J. L. Mcclelland, B. L. Mcnaughton, and R. C. O-'reilly, Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory., Psychological Review, vol.102, issue.3, pp.419-457, 1995.
DOI : 10.1037/0033-295X.102.3.419

S. Mcclure, M. Gilzenrat, and J. Cohen, An exploration-exploitation model based on norepinepherine and dopamine activity, Advances in Neural Information Processing Systems 18, pp.867-874, 2006.

Y. Niv, Cost, Benefit, Tonic, Phasic: What Do Response Rates Tell Us about Dopamine and Motivation?, Annals of the New York Academy of Sciences, vol.23, issue.1, pp.357-376, 2007.
DOI : 10.1016/j.tics.2004.07.009

W. M. Pauli, T. E. Hazy, and R. C. O-'reilly, Expectancy, Ambiguity, and Behavioral Flexibility: Separable and Complementary Roles of the Orbital Frontal Cortex and Amygdala in Processing Reward Expectancies, Journal of Cognitive Neuroscience, vol.19, issue.2, pp.351-366, 2011.
DOI : 10.1111/j.1460-9568.2005.04218.x

W. M. Pauli and R. C. O-'reilly, Attentional control of associative learning???A possible role of the central cholinergic system, Brain Research, vol.1202, pp.43-53, 2008.
DOI : 10.1016/j.brainres.2007.06.097

S. J. Sara and S. Bouret, Orienting and Reorienting: The Locus Coeruleus Mediates Cognition through Arousal, Neuron, vol.76, issue.1, pp.130-141, 2012.
DOI : 10.1016/j.neuron.2012.09.011

W. Schultz, Predictive reward signal of dopamine neurons, Journal of Neurophysiology, vol.80801, issue.11, pp.1-27, 1998.

D. Silver, Q. Yang, and L. Li, Lifelong machine learning systems: Beyond learning algorithms, AAAI Spring Symposium Series, 2013.

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

A. J. Yu and P. Dayan, Uncertainty, Neuromodulation, and Attention, Neuron, vol.46, issue.4, 2005.
DOI : 10.1016/j.neuron.2005.04.026