L. F. Abbott and S. B. Nelson, Synaptic plasticity: taming the beast, Nature Neuroscience, vol.3, issue.Supp, pp.1178-83, 2000.
DOI : 10.1038/81453

J. Blynel and D. Floreano, Levels of dynamics and adaptive behavior in evolutionary neural controllers, Proc. of SAB, 2002.

D. Chalmers, The Evolution of Learning: An Experiment in Genetic Connectionism, Connectionist Models Summer School, 1990.
DOI : 10.1016/B978-1-4832-1448-1.50014-7

J. Clune, K. O. Stanley, R. T. Pennock, and C. Ofria, On the Performance of Indirect Encoding Across the Continuum of Regularity, IEEE Transactions on Evolutionary Computation, vol.15, issue.3, 2011.
DOI : 10.1109/TEVC.2010.2104157

K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA-II, IEEE Transactions on Evolutionary Computation, vol.6, issue.2, pp.182-197, 2002.
DOI : 10.1109/4235.996017

B. Girard, N. Tabareau, A. Berthoz, and J. Slotine, Selective amplification using a contracting model of the basal ganglia, pp.30-33, 2006.
URL : https://hal.archives-ouvertes.fr/hal-00111145

F. Gruau and D. Whitley, Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin Effect, Evolutionary Computation, vol.4, issue.3, pp.213-233, 1993.
DOI : 10.1016/0167-8191(90)90086-O

G. S. Hornby, Measuring, enabling and comparing modularity, regularity and hierarchy in evolutionary design, Proceedings of the 2005 conference on Genetic and evolutionary computation , GECCO '05, 2005.
DOI : 10.1145/1068009.1068297

G. S. Hornby and J. B. Pollack, Creating High-Level Components with a Generative Representation for Body-Brain Evolution, Artificial Life, vol.27, issue.3, pp.223-246, 2002.
DOI : 10.1162/106454601300328034

H. Kimura and S. Kobayashi, An Analysis of Actor-Critic Algorithms Using Eligibility Traces: Reinforcement Learning with Imperfect Value Functions, Journal of Japanese Society for AI, vol.15, issue.2, pp.267-275, 2000.

J. Lehman and K. O. Stanley, Abandoning Objectives: Evolution Through the Search for Novelty Alone, Evolutionary Computation, vol.7, issue.3, 2011.
DOI : 10.1016/0165-6074(93)90215-7

C. Mattiussi and D. Floreano, Analog Genetic Encoding for the Evolution of Circuits and Networks, IEEE Transactions on Evolutionary Computation, vol.11, issue.5, pp.596-607, 2007.
DOI : 10.1109/TEVC.2006.886801

J. Mouret and S. Doncieux, Using behavioral exploration objectives to solve deceptive problems in neuro-evolution, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, 2009.
DOI : 10.1145/1569901.1569988
URL : https://hal.archives-ouvertes.fr/hal-00473132

J. Mouret, S. Doncieux, and B. Girard, Importing the computational neuroscience toolbox into neuro-evolution-application to basal ganglia, Proceedings of the 12th annual conference on Genetic and evolutionary computation, GECCO '10, 2010.
DOI : 10.1145/1830483.1830592
URL : https://hal.archives-ouvertes.fr/hal-00687639

Y. Niv, D. Joel, I. Meilijson, and E. Ruppin, Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors, Adaptive Behavior, vol.10, issue.1, pp.5-24, 2002.
DOI : 10.1177/1059-712302-010001-01

S. Risi and K. O. Stanley, Indirectly Encoding Neural Plasticity as a Pattern of Local Rules, Proc. of SAB, 2010.
DOI : 10.1007/978-3-642-15193-4_50

S. Risi, S. D. Vanderbleek, C. E. Hughes, and K. O. Stanley, How novelty search escapes the deceptive trap of learning to learn, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, 2009.
DOI : 10.1145/1569901.1569923

A. Soltoggio, J. Bullinaria, C. Mattiussi, P. Dürr, and D. Floreano, Evolutionary advantages of neuromodulated plasticity in dynamic, reward-based scenarios, Artificial Life, vol.11, p.569, 2008.

A. Soltoggio, P. Dürr, C. Mattiussi, and D. Floreano, Evolving neuromodulatory topologies for reinforcement learning-like problems, 2007 IEEE Congress on Evolutionary Computation, 2007.
DOI : 10.1109/CEC.2007.4424781

A. Soltoggio and B. Jones, Novelty of behaviour as a basis for the neuro-evolution of operant reward learning, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, 2009.
DOI : 10.1145/1569901.1569925

K. O. Stanley, B. D. Bryant, and R. Miikkulainen, Evolving adaptive neural networks with and without adaptive synapses, The 2003 Congress on Evolutionary Computation, 2003. CEC '03., 2003.
DOI : 10.1109/CEC.2003.1299410

K. O. Stanley, D. Ambrosio, and J. Gauci, A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks, Artificial Life, vol.21, issue.2, pp.185-212, 2009.
DOI : 10.1109/5.784219

K. O. Stanley and R. Miikkulainen, Evolving Neural Networks through Augmenting Topologies, Evolutionary Computation, vol.7, issue.2, pp.99-127, 2002.
DOI : 10.1016/S0096-3003(97)10005-4

R. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

T. P. Trappenberg, M. C. Dorris, D. P. Munoz, and R. M. Klein, A Model of Saccade Initiation Based on the Competitive Integration of Exogenous and Endogenous Signals in the Superior Colliculus, Journal of Cognitive Neuroscience, vol.78, issue.2, pp.256-271, 2001.
DOI : 10.1007/BF00207285

E. Tuci and M. Quinn, Behavioral Plasticity in Autonomous Agents: a Comparison Between Two Types of Controller, Proc. of Applications of evolutionary computing, 2003.

J. Urzelai and D. Floreano, Evolution of Adaptive Synapses: Robots with Fast Adaptive Behavior in New Environments, Evolutionary Computation, vol.4, issue.4, pp.495-524, 2001.
DOI : 10.1162/neco.1990.2.1.85