R. French, Catastrophic forgetting in connectionist networks, Trends in Cognitive Sciences, vol.3, issue.4, pp.128-135, 1999.
DOI : 10.1016/S1364-6613(99)01294-2

M. Mermillod, A. Bugaiska, and P. Bonin, The stability-plasticity dilemma: investigating the continuum from catastrophic forgetting to age-limited learning effects, Frontiers in Psychology, vol.4, p.23935590, 2013.
DOI : 10.3389/fpsyg.2013.00504
URL : https://hal.archives-ouvertes.fr/hal-00965078

R. Ajemian, D. Ausilio, A. Moorman, H. Bizzi, and E. , A theory for how sensorimotor skills are learned and retained in noisy and nonstationary neural circuits, Proceedings of the National Academy of Sciences, vol.110, issue.52, pp.5078-87, 2013.
DOI : 10.1073/pnas.1320116110

S. Haykin, Neural networks and learning machines, 2009.

D. Floreano and C. Mattiussi, Bio-inspired artificial intelligence: theories, methods, and technologies, 2008.

B. Widrow and M. Lehr, 30 years of adaptive neural networks: perceptron, Madaline, and backpropagation, Proceedings of the IEEE, vol.78, issue.9, pp.1415-1442, 1990.
DOI : 10.1109/5.58323

D. Rummelhart, G. Hinton, and R. Williams, Learning representations by back-propagating errors, Nature, vol.85, issue.6088, pp.533-535, 1986.
DOI : 10.1038/323533a0

A. Soltoggio, Neural Plasticity and Minimal Topologies for Reward-Based Learning, 2008 Eighth International Conference on Hybrid Intelligent Systems, pp.637-642, 2008.
DOI : 10.1109/HIS.2008.155

M. Mccloskey and N. Cohen, Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem, Psychol Learn Motiv, vol.24, issue.08, pp.109-165, 1989.
DOI : 10.1016/S0079-7421(08)60536-8

R. Ratcliff, Connectionist models of recognition memory: Constraints imposed by learning and forgetting functions., Psychological Review, vol.97, issue.2, pp.285-308, 1990.
DOI : 10.1037/0033-295X.97.2.285

J. Barnes and B. Underwood, "Fate" of first-list associations in transfer theory., Journal of Experimental Psychology, vol.58, issue.2, pp.97-105, 1959.
DOI : 10.1037/h0047507

T. Aaltonen, J. Adelman, T. Akimoto, M. Albrow, A. González et al., Measurement of the Top-Quark Mass with Dilepton Events Selected Using Neuroevolution at CDF, Physical Review Letters, vol.102, issue.15, 2009.
DOI : 10.1103/PhysRevLett.102.152001
URL : https://hal.archives-ouvertes.fr/in2p3-00375592

R. Anemone, C. Emerson, and G. Conroy, Finding fossils in new ways: An artificial neural network approach to predicting the location of productive fossil localities, Evolutionary Anthropology: Issues, News, and Reviews, vol.460, issue.Suppl, p.22034235, 2011.
DOI : 10.1002/evan.20324

A. Ramesh, C. Kambhampati, J. Monson, and P. Drew, Artificial intelligence in medicine, Annals of The Royal College of Surgeons of England, vol.86, issue.5, pp.334-338, 2004.
DOI : 10.1308/147870804290

T. Seipone and J. Bullinaria, The evolution of minimal catastrophic forgetting in neural systems, Proc Annu Conf Cogn Sci Soc. Cognitive Science Society, pp.1991-1996, 2005.

B. Ans and S. Rousset, Neural networks with a self-refreshing memory: Knowledge transfer in sequential learning tasks without catastrophic forgetting, Connection Science, vol.12, issue.1, pp.1-19, 2000.
DOI : 10.1080/095400900116177
URL : https://hal.archives-ouvertes.fr/hal-00170862

U. Alon, An Introduction to Systems Biology: Design Principles of Biological Circuits, 2006.

S. Carroll, Chance and necessity: the evolution of morphological complexity and diversity, Nature, vol.409, issue.6823, pp.1102-1109, 2001.
DOI : 10.1038/35059227

G. Wagner, M. Pavlicev, and J. Cheverud, The road to modularity, Nature Reviews Genetics, vol.24, issue.12, pp.921-931, 2007.
DOI : 10.1038/nrg2267

A. Hintze and C. Adami, Evolution of complex modular biological networks, PLoS Comput Biol, vol.4, p.18266463, 2008.

V. Mountcastle, The columnar organization of the neocortex, Brain, vol.120, issue.4, pp.701-722, 1997.
DOI : 10.1093/brain/120.4.701

H. Lipson, Principles of modularity, regularity, and hierarchy for scalable systems, Journal of Biological Physics and Chemistry, vol.7, issue.4, 2007.
DOI : 10.4024/40701.jbpc.07.04

J. Clune, J. Mouret, and H. Lipson, The evolutionary origins of modularity, Proceedings of the Royal Society B: Biological Sciences, vol.19, issue.2, 2013.
DOI : 10.1162/EVCO_a_00025
URL : https://hal.archives-ouvertes.fr/hal-01300705

B. Burrell and C. Sahley, Learning in simple systems, Current Opinion in Neurobiology, vol.11, issue.6, pp.757-764, 2001.
DOI : 10.1016/S0959-4388(01)00281-1

A. Soltoggio, J. Bullinaria, C. Mattiussi, P. Dürr, and D. Floreano, Evolutionary Advantages of Neuromodulated Plasticity in Dynamic, Reward-based Scenarios, Artif Life, vol.11, pp.569-576, 2008.

C. Cherniak, Z. Mokhtarzada, R. Rodriguez-esteban, and K. Changizi, Global optimization of cerebral cortex layout, Proceedings of the National Academy of Sciences, vol.101, issue.4, pp.1081-1086, 2004.
DOI : 10.1073/pnas.0305212101

Y. Ahn, H. Jeong, and B. Kim, Wiring cost in the organization of a biological neuronal network, Physica A: Statistical Mechanics and its Applications, vol.367, pp.531-537, 2006.
DOI : 10.1016/j.physa.2005.12.013

G. Striedter, Principles of brain evolution, 2005.

C. Kortge, Episodic memory in connectionist networks, Proc Annu Conf Cogn Sci Soc, pp.764-771, 1990.

S. Lewandowsky and S. Li, Catastrophic interference in neural networks, New Perspectives on Interference and Inhibition in Cognition, pp.329-361, 1993.
DOI : 10.1016/B978-012208930-5/50011-8

R. French, Using semi-distributed representations to overcome catastrophic forgetting in connectionist networks, Proceedings of the 13th Annual Congitive Science Society Conference, pp.173-178, 1991.

R. French, Dynamically constraining connectionist networks to produce distributed, orthogonal representations to reduce catastrophic interference, Proc Annu Conf Cogn Sci Soc, pp.335-340, 1994.

R. French, Pseudo-recurrent Connectionist Networks: An Approach to the 'Sensitivity-Stability' Dilemma, Connection Science, vol.9, issue.4, pp.353-379, 1997.
DOI : 10.1080/095400997116595

A. Robins, Catastrophic Forgetting;Catastrophic Interference;Stability;Plasticity;Rehearsal., Connection Science, vol.7, issue.2, pp.123-146, 1995.
DOI : 10.1080/09540099550039318

J. Mcclelland, B. Mcnaughton, O. Reilly, and R. , Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory., Psychological Review, vol.102, issue.3, p.7624455, 1995.
DOI : 10.1037/0033-295X.102.3.419

B. Ans and S. Rousset, Avoiding catastrophic forgetting by coupling two reverberating neural networks, Comptes Rendus de l'Acad??mie des Sciences - Series III - Sciences de la Vie, vol.320, issue.12, pp.989-997, 1997.
DOI : 10.1016/S0764-4469(97)82472-9
URL : https://hal.archives-ouvertes.fr/hal-00171579

Y. Xin, Evolving artificial neural networks, Proceedings of the IEEE, vol.87, issue.9, pp.1423-1447, 1999.
DOI : 10.1109/5.784219

J. Holland, Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control, and artificial intelligence, 1975.

K. Stanley and R. Miikkulainen, Evolving Neural Networks through Augmenting Topologies, Evolutionary Computation, vol.7, issue.2, pp.99-127, 2002.
DOI : 10.1016/S0096-3003(97)10005-4
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.18.4591

J. Koza, Genetic programming IV: Routine human-competitive machine intelligence, 2003.

G. Hornby, J. Lohn, and D. Linden, Computer-Automated Evolution of an X-Band Antenna for NASA's Space Technology 5 Mission, Evolutionary Computation, vol.3, issue.2, pp.1-23, 2011.
DOI : 10.1109/22.238519

F. Gomez and R. Miikkulainen, Active Guidance for a Finless Rocket Using Neuroevolution, Proc Genet Evol Comput Conf, pp.2084-2095, 2003.
DOI : 10.1007/3-540-45110-2_105

J. Clune, B. Beckmann, C. Ofria, and R. Pennock, Evolving coordinated quadruped gaits with the HyperNEAT generative encoding, 2009 IEEE Congress on Evolutionary Computation, pp.2764-2771, 2009.
DOI : 10.1109/CEC.2009.4983289

G. Hornby, S. Takamura, T. Yamamoto, and M. Fujita, Autonomous evolution of dynamic gaits with two quadruped robots, IEEE Transactions on Robotics, vol.21, issue.3, pp.402-410, 2004.
DOI : 10.1109/TRO.2004.839222

D. Hebb, The Organization of Behavior, 1949.

Y. Niv, J. D. Meilijson, I. Ruppin, and E. , Evolution of Reinforcement Learning in Uncertain Environments: A Simple Explanation for Complex Foraging Behaviors, Adaptive Behavior, vol.10, issue.1, pp.5-24, 2002.
DOI : 10.1177/1059-712302-010001-01

K. Ellefsen, Balancing the Costs and Benefits of Learning Ability, European Conference of Artificial Life, pp.292-299, 2013.

J. Urzelai and D. Floreano, Evolution of Adaptive Synapses: Robots with Fast Adaptive Behavior in New Environments, Evolutionary Computation, vol.4, issue.4, pp.495-524, 2001.
DOI : 10.1162/neco.1990.2.1.85

J. Blynel and D. Floreano, Levels of dynamics and adaptive behavior in evolutionary neural controllers, 7th International Conference on Simulation on Adaptive Behavior, pp.272-281, 2002.

G. Hinton and S. Nowlan, How learning can guide evolution, Complex Systems, vol.1, pp.495-502, 1987.

S. Nolfi, D. Parisi, and J. Elman, Learning and Evolution in Neural Networks, Adaptive Behavior, vol.3, issue.1, pp.5-28, 1994.
DOI : 10.1177/105971239400300102

G. Mayley, Landscapes, Learning Costs, and Genetic Assimilation, Evolutionary Computation, vol.1, issue.3, pp.213-234, 1996.
DOI : 10.1126/science.4.99.733
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.29.7971

T. Sasaki and M. Tokoro, Evolving Learnable Neural Networks Under Changing Environments with Various Rates of Inheritance of Acquired Characters: Comparison of Darwinian and Lamarckian Evolution, Artificial Life, vol.4, issue.3, pp.203-223, 1999.
DOI : 10.1177/105971239600500104

T. Jay, Dopamine: a potential substrate for synaptic plasticity and memory mechanisms, Progress in Neurobiology, vol.69, issue.6, pp.375-390, 2003.
DOI : 10.1016/S0301-0082(03)00085-6

L. Abbott and W. Regehr, Synaptic computation, Nature, vol.22, issue.7010, pp.796-803, 2004.
DOI : 10.1016/S0896-6273(02)00659-1

M. Pigliucci, Is evolvability evolvable?, Nature Reviews Genetics, vol.49, issue.1, pp.75-82, 2008.
DOI : 10.1038/nrg2278

N. Kashtan and U. Alon, Spontaneous evolution of modularity and network motifs, Proceedings of the National Academy of Sciences, vol.102, issue.39, pp.13773-13778, 2005.
DOI : 10.1073/pnas.0503610102

B. Hoverstad, Noise and the Evolution of Neural Network Modularity, Artificial Life, vol.106, issue.1, pp.33-50, 2011.
DOI : 10.1038/35004572

C. Espinosa-soto and A. Wagner, Specialization Can Drive the Evolution of Modularity, PLoS Computational Biology, vol.103, issue.3, p.20360969, 2010.
DOI : 10.1371/journal.pcbi.1000719.s008

J. Clune, B. Beckmann, P. Mckinley, and C. Ofria, Investigating whether hyperNEAT produces modular neural networks, Proceedings of the 12th annual conference on Genetic and evolutionary computation, GECCO '10, pp.635-642, 2010.
DOI : 10.1145/1830483.1830598
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.409.4870

P. Verbancsics and K. Stanley, Constraining connectivity to encourage modularity in HyperNEAT, Proceedings of the 13th annual conference on Genetic and evolutionary computation, GECCO '11, pp.1483-1490, 2011.
DOI : 10.1145/2001576.2001776

A. Dunlap and D. Stephens, Components of change in the evolution of learning and unlearned preference, Proceedings of the Royal Society B: Biological Sciences, vol.36, issue.1, 2009.
DOI : 10.1093/beheco/2.1.77

K. Tanaka, Inferotemporal Cortex and Object Vision, Annual Review of Neuroscience, vol.19, issue.1, p.8833438, 1996.
DOI : 10.1146/annurev.ne.19.030196.000545

M. Newman, Modularity and community structure in networks, Proceedings of the National Academy of Sciences, vol.103, issue.23, pp.8577-8582, 2006.
DOI : 10.1073/pnas.0601602103

R. Guimerà, M. Sales-pardo, and L. Amaral, Modularity from fluctuations in random graphs and complex networks, Physical Review E, vol.70, issue.2, p.15447530, 2004.
DOI : 10.1103/PhysRevE.70.025101

E. Leicht and M. Newman, Community Structure in Directed Networks, Physical Review Letters, vol.100, issue.11, pp.118703-118707, 2008.
DOI : 10.1103/PhysRevLett.100.118703

P. Cohen, Empirical Methods for Artificial Intelligence, 1995.

P. Tonelli and J. Mouret, On the relationships between synaptic plasticity and generative systems, Proceedings of the 13th annual conference on Genetic and evolutionary computation, GECCO '11, pp.1531-1538, 2011.
DOI : 10.1145/2001576.2001782
URL : https://hal.archives-ouvertes.fr/hal-00687621

K. Stanley and R. Miikkulainen, A Taxonomy for Artificial Embryogeny, Artificial Life, vol.13, issue.1, pp.93-130, 2003.
DOI : 10.1002/cne.902460104

J. Clune, K. Stanley, R. Pennock, and C. Ofria, On the Performance of Indirect Encoding Across the Continuum of Regularity, IEEE Transactions on Evolutionary Computation, vol.15, issue.3, pp.346-367, 2010.
DOI : 10.1109/TEVC.2010.2104157

K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA-II, IEEE Transactions on Evolutionary Computation, vol.6, issue.2, pp.182-197, 2002.
DOI : 10.1109/4235.996017

J. Mouret and S. Doncieux, Encouraging Behavioral Diversity in Evolutionary Robotics: An Empirical Study, Evolutionary Computation, vol.341, issue.1, pp.91-113, 2012.
DOI : 10.1016/0020-0190(92)90136-J
URL : https://hal.archives-ouvertes.fr/hal-00687609

S. Risi, S. Vanderbleek, C. Hughes, and K. Stanley, How novelty search escapes the deceptive trap of learning to learn, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, pp.153-160, 2009.
DOI : 10.1145/1569901.1569923

J. Mouret and S. Doncieux, SFERES v2: Evolvin' in the Multi-Core World, Proc Congr Evol Comput . IEEE, issue.2, pp.4079-4086, 2010.
URL : https://hal.archives-ouvertes.fr/hal-00687633

P. Tonelli and J. Mouret, On the Relationships between Generative Encodings, Regularity, and Learning Abilities when Evolving Plastic Artificial Neural Networks, PLoS ONE, vol.315, issue.11, p.24236099, 2013.
DOI : 10.1371/journal.pone.0079138.s001
URL : https://hal.archives-ouvertes.fr/hal-01264752

U. Brandes, D. Delling, M. Gaertler, R. Gorke, and M. Hoefer, On Modularity Clustering, IEEE Transactions on Knowledge and Data Engineering, vol.20, issue.2, pp.172-188, 2007.
DOI : 10.1109/TKDE.2007.190689

S. Fortunato, Community detection in graphs, Physics Reports, vol.486, issue.3-5, pp.75-174, 2010.
DOI : 10.1016/j.physrep.2009.11.002