G. Baele, N. Bredeche, E. Haasdijk, S. Maere, and N. Michiels, Yves Van de Peer, Thomas Schmickl, Christopher Schwarzer, and Ronald Thenius. Open-ended on-board evolutionary robotics for robot swarms, Proceedings of the IEEE Conference on Evolutionary Computation, pp.1123-1130, 2009.

A. Mark and . Bedau, Comparison of the growth of adaptive structure in artificial life models and in the fossil record, PaleoBios, vol.21, issue.30, 2001.

A. Mark, J. S. Bedau, N. H. Mccaskill, S. Packard, C. Rasmussen et al., Open problems in artificial life, Artificial Life, vol.6, pp.363-376, 2000.

D. S. Bernstein, R. Givan, N. Immerman, and S. Zilberstein, The Complexity of Decentralized Control of Markov Decision Processes, Mathematics of Operations Research, vol.27, issue.4, pp.819-840, 2002.
DOI : 10.1287/moor.27.4.819.297

H. Beyer and H. Schwefel, Evolution strategies ? A comprehensive introduction, Natural Computing, vol.1, issue.1, pp.3-52, 2002.
DOI : 10.1023/A:1015059928466

E. Bonabeau, M. Dorigo, and G. Theraulaz, Swarm Intelligence: From Natural to Artificial Systems, 1999.

N. Bredeche, E. Haasdijk, and A. E. Eiben, On-Line, On-Board Evolution of Robot Controllers, Proceedings of Artificial Evolution / Evolution Artificielle (EA'09), pp.110-121, 2009.
DOI : 10.1007/978-3-642-14156-0_10

URL : https://hal.archives-ouvertes.fr/inria-00413259

G. Caprari, T. Estier, and R. Siegwart, Fascination of down scaling ??? Alice the sugar cube robot, Journal of Micromechatronics, vol.1, issue.3, pp.177-189, 2002.
DOI : 10.1163/156856301760132097

S. Erol and W. Spears, Swarm Robotics Workshop: State-of-the-art Survey, Lecture Notes in Computer Science, vol.3342, 2005.

R. Dawkins, The Selfish Gene, 1976.

S. Elfwing, E. Uchibe, K. Doya, H. I. Christensen-marco-dorigo, G. Eiben et al., Biologically Inspired Embodied Evolution of Survival, 2005 IEEE Congress on Evolutionary Computation, pp.2210-2216, 2005.
DOI : 10.1109/CEC.2005.1554969

S. Ficici, R. Watson, and J. Pollack, Embodied evolution: A response to challenges in evolutionary robotics, Proceedings of the Eighth European Workshop on Learning Robots, pp.14-22, 1999.

J. A. Fletcher, M. A. Bedau, and M. Zwick, Effect of environmental structure on evolutionary adaptation, Artificial Life VI, pp.189-198, 1998.

R. Gross, M. Bonani, F. Mondada, and M. Dorigo, Autonomous Self-assembly in Swarm-Bots, IEEE Transactions on Robotics, vol.22, issue.6, pp.1115-1130, 2006.

J. H. Holland, Echoing emergence: Objectives, rough definitions, and speculations for echo?class models, Complexity: Metaphors, Models and Reality, pp.309-342, 1994.

N. Jakobi, P. Husband, and I. Harvey, Noise and the reality gap: The use of simulation in evolutionary robotics, Advances in Artificial Life: Proceedings of the Third European Conference on Artificial Life, pp.704-720, 1995.
DOI : 10.1007/3-540-59496-5_337

N. Kohl and P. Stone, Policy gradient reinforcement learning for fast quadrupedal locomotion, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004, pp.2619-2624, 2004.
DOI : 10.1109/ROBOT.2004.1307456

S. Kornienko, O. Kornienko, and P. Levi, Collective AI: context awareness via communication, IJCAI'05: Proceedings of the 19th international joint conference on Artificial intelligence, pp.1464-1470, 2005.

J. Lehman and K. O. Stanley, Abandoning Objectives: Evolution Through the Search for Novelty Alone, Evolutionary Computation, vol.7, issue.3, 2010.
DOI : 10.1016/0165-6074(93)90215-7

W. Liu and A. F. Winfield, Open-hardware e-puck Linux extension board for experimental swarm robotics research, Microprocessors and Microsystems, vol.35, issue.1, pp.60-67, 2011.
DOI : 10.1016/j.micpro.2010.08.002

P. Marbach and J. N. Tsitsiklis, Approximate gradient methods in policy-space optimization of markov reward processes, Discrete Event Dynamic Systems, vol.13, issue.1/2, pp.111-148, 2003.
DOI : 10.1023/A:1022145020786

F. Mondada, M. Bonani, X. Raemy, J. Pugh, C. Cianci et al., The e-puck, a robot designed for education in engineering, Proceedings of the 9th Conference on Autonomous Robot Systems and Competitions, pp.59-65, 2009.

J. Montanier and N. Bredeche, Embedded Evolutionary Robotics: The (1+1)-Restart-Online Adaptation Algorithm, New Horizons in Evolutionary Robotics: Extended Contributions from the 2009 EvoDeRob Workshop, pp.155-168, 2011.
DOI : 10.1007/978-3-642-18272-3_11

URL : https://hal.archives-ouvertes.fr/inria-00566898

S. Nolfi and D. Floreano, Evolutionary Robotics, 2000.
DOI : 10.1007/978-3-319-32552-1_76

T. Ray, Is it alive, or is it GA?, Proceedings of International Conference on Genetic Algorithms, 1991.

C. Rosin and R. Belew, New Methods for Competitive Coevolution, Evolutionary Computation, vol.1, issue.3, pp.1-29, 1996.
DOI : 10.1162/evco.1993.1.2.127

L. Spector, J. Klein, C. Perry, and M. Feinstein, Emergence of Collective Behavior in Evolving Populations of Flying Agents, Genetic Programming and Evolvable Machines, vol.3, issue.1, pp.111-125, 2005.
DOI : 10.1007/s10710-005-7620-3

M. Taylor, S. Whiteson, and P. Stone, Comparing evolutionary and temporal difference methods in a reinforcement learning domain, Proceedings of the 8th annual conference on Genetic and evolutionary computation , GECCO '06, pp.1321-1328, 2006.
DOI : 10.1145/1143997.1144202

M. E. Taylor, S. Whiteson, and P. Stone, Temporal difference and policy search methods for reinforcement learning: An empirical comparison, Proceedings of the Twenty-Second Conference on Artificial Intelligence (AAAI-07), pp.1675-1678, 2007.

V. Trianni, S. Nolfi, and M. Dorigo, Evolution, Self-organization and Swarm Robotics, Swarm Intelligence, Natural Computing Series, pp.163-191, 2008.
DOI : 10.1007/978-3-540-74089-6_5

Y. Usui and T. Arita, Situated and embodied evolution in collective evolutionary robotics, Proceedings of the 8th International Symposium on Artificial Life and Robotics, pp.212-215, 2003.

R. Vaughan, Massively multi-robot simulation in stage, Swarm Intelligence, vol.17, issue.2-3, pp.189-208, 2008.
DOI : 10.1007/s11721-008-0014-4

R. A. Watson, S. G. Ficici, and J. B. Pollack, Embodied Evolution: Distributing an evolutionary algorithm in a population of robots, Robotics and Autonomous Systems, vol.39, issue.1, pp.1-18, 2002.
DOI : 10.1016/S0921-8890(02)00170-7

R. J. Williams, Simple statistical gradient-following algorithms for connectionist reinforcement learning, Machine Learning, pp.229-256, 1992.

A. F. Winfield and O. E. Holland, The application of wireless local area network technology to the control of mobile robots, Microprocessors and Microsystems, vol.23, issue.10, pp.597-607, 2000.
DOI : 10.1016/S0141-9331(99)00074-5

S. Wischmann, K. Stamm, and F. Wörgötter, Embodied Evolution and Learning: The??Neglected Timing of Maturation, Advances in Artificial Life: 9th European Conference on Artificial Life, pp.284-293, 2007.
DOI : 10.1007/978-3-540-74913-4_29

H. David, K. Wolpert, and . Tumer, Optimal payoff functions for members of collectives, Advances in Complex Systems, pp.265-279, 2001.