C. H. Bailey, M. Giustetto, Y. Y. Huang, R. D. Hawkins, and E. R. Kandel, Is heterosynaptic modulation essential for stabilizing Hebbian plasticity and memory?, Nature Reviews Neuroscience, vol.1, issue.1, pp.11-20, 2000.
DOI : 10.1038/35036191

J. Blynel and D. Floreano, Levels of dynamics and adaptive behavior in evolutionary neural controllers, Proceedings of the 7th conference on Simulation of Adaptive Behavior (SAB'02), pp.272-281, 2002.

D. Chalmers, The Evolution of Learning: An Experiment in Genetic Connectionism, Connectionist Models Summer School, 1990.
DOI : 10.1016/B978-1-4832-1448-1.50014-7

J. Clune, K. O. Stanley, R. T. Pennock, and C. Ofria, On the Performance of Indirect Encoding Across the Continuum of Regularity, IEEE Transactions on Evolutionary Computation, vol.15, issue.3, 2011.
DOI : 10.1109/TEVC.2010.2104157

N. D. Daw, Y. Niv, and P. Dayan, Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control, Nature Neuroscience, vol.58, issue.12, pp.1704-1715, 2005.
DOI : 10.1038/nn1560

D. Floreano, Evolution of plastic neurocontrollers for situated agents, Proceedings of the 4th conference on Simulation of Adaptive Behavior (SAB'96), 1996.

D. Floreano, P. Dürr, and C. Mattiussi, Neuroevolution: from architectures to learning, Evolutionary Intelligence, vol.87, issue.9, pp.47-62, 2008.
DOI : 10.1007/s12065-007-0002-4

D. Floreano and C. Mattiussi, Bio-inspired artificial intelligence: theories, methods, and technologies, 2008.

S. Haykin, Neural networks: a comprehensive foundation, 1999.

J. Kodjabachian and J. A. Meyer, Evolution and development of neural controllers for locomotion, gradient-following, and obstacle-avoidance in artificial insects, IEEE Transactions on Neural Networks, vol.9, issue.5, pp.796-812, 1998.
DOI : 10.1109/72.712153
URL : https://hal.archives-ouvertes.fr/hal-01184992

T. Kondo, Evolutionary design and behavior analysis of neuromodulatory neural networks for mobile robots control, Applied Soft Computing, vol.7, issue.1, pp.189-202, 2007.
DOI : 10.1016/j.asoc.2005.05.004

J. B. Mouret and S. Doncieux, Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study, Evolutionary Computation, vol.341, issue.1, pp.91-133, 2012.
DOI : 10.1016/0020-0190(92)90136-J
URL : https://hal.archives-ouvertes.fr/hal-00687609

J. B. Mouret, S. Doncieux, and B. Girard, Importing the computational neuroscience toolbox into neuro-evolution-application to basal ganglia, Proceedings of the 12th annual conference on Genetic and evolutionary computation, GECCO '10, pp.587-594, 2010.
DOI : 10.1145/1830483.1830592
URL : https://hal.archives-ouvertes.fr/hal-00687639

Y. Niv, D. Joel, I. Meilijson, and E. Ruppin, Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors, Adaptive Behavior, vol.10, issue.1, pp.5-24, 2002.
DOI : 10.1177/1059-712302-010001-01

S. Nolfi, How Learning and Evolution Interact: The Case of a Learning Task which Differs from the Evolutionary Task, Adaptive Behavior, vol.7, issue.2, 1999.
DOI : 10.1177/105971239900700205

S. Nolfi, O. Miglino, and D. Parisi, Phenotypic plasticity in evolving neural networks, Proceedings of PerAc '94. From Perception to Action, pp.146-157, 1994.
DOI : 10.1109/FPA.1994.636092

S. Risi and K. O. Stanley, Indirectly Encoding Neural Plasticity as a Pattern of Local Rules, Proceedings of the 11th conference on Simulation of Adaptive Behavior (SAB'10, pp.533-543, 2010.
DOI : 10.1007/978-3-642-15193-4_50

S. Risi, S. D. Vanderbleek, C. E. Hughes, and K. O. Stanley, How novelty search escapes the deceptive trap of learning to learn, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, 2009.
DOI : 10.1145/1569901.1569923

W. Schultz, P. Dayan, and P. R. Montague, A Neural Substrate of Prediction and Reward, Science, vol.275, issue.5306, pp.1593-1599, 1997.
DOI : 10.1126/science.275.5306.1593

B. F. Skinner, Operant behavior., American Psychologist, vol.18, issue.8, p.503, 1963.
DOI : 10.1037/h0045185

A. Soltoggio, J. Bullinaria, C. Mattiussi, P. Dürr, and D. Floreano, Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios, Artificial Life, vol.11, p.569, 2008.

A. Soltoggio, P. Dürr, C. Mattiussi, and D. Floreano, Evolving neuromodulatory topologies for reinforcement learning-like problems, 2007 IEEE Congress on Evolutionary Computation, 2007.
DOI : 10.1109/CEC.2007.4424781

A. Soltoggio and B. Jones, Novelty of behaviour as a basis for the neuro-evolution of operant reward learning, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, 2009.
DOI : 10.1145/1569901.1569925

K. O. Stanley, B. D. Bryant, and R. Miikkulainen, Evolving adaptive neural networks with and without adaptive synapses, The 2003 Congress on Evolutionary Computation, 2003. CEC '03., pp.2257-2564, 2003.
DOI : 10.1109/CEC.2003.1299410

K. O. Stanley, D. D-'ambrosio, and J. Gauci, A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks, Artificial Life, vol.21, issue.2, pp.185-212, 2009.
DOI : 10.1109/5.784219

K. O. Stanley and R. Miikkulainen, Evolving Neural Networks through Augmenting Topologies, Evolutionary Computation, vol.7, issue.2, pp.99-127, 2002.
DOI : 10.1016/S0096-3003(97)10005-4
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.18.4591

R. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

P. Tonelli and J. B. Mouret, On the relationships between synaptic plasticity and generative systems, Proceedings of the 13th annual conference on Genetic and evolutionary computation, GECCO '11, pp.259-266, 2011.
DOI : 10.1145/2001576.2001782
URL : https://hal.archives-ouvertes.fr/hal-00687621

J. Urzelai and D. Floreano, Evolution of Adaptive Synapses: Robots with Fast Adaptive Behavior in New Environments, Evolutionary Computation, vol.4, issue.4, pp.495-524, 2001.
DOI : 10.1162/neco.1990.2.1.85