Creation of Autonomous Artificial Intelligent Agents using Novelty Search method of fitness function optimization

Iaroslav Omelianenko (1)

1 NewGround LLC

Search for Novelty is an universal method of biological life evolution through introduction of the random beneficial mutations to the genetic code of the organism. In this work we describe experiment of applying Novelty Search method of fitness function optimization combined with Neuro-Evolution of Augmented Topologies (NEAT) algorithm to produce Autonomous Artificial Intelligent Agents capable to solve spatial navigation task in complex maze environment. The AI Agents produced by the neuro-evolution method described by the NEAT algorithm evolve through gradual complexification of their internal neural network by augmenting its topologies. Finally, we consider how to apply studied optimization methods and evolutionary algorithms to create ensembles of compact modular AI systems trained using vocabulary of terms describing real world settings. And how to control such ensembles by specialized supervisors knowledgeable about the task and the operating environment. We provide the complete source code for implementing the NEAT algorithm, including Novelty Search and Objective-Based optimization methods, in the GO programming language.

Mots clés: objective-based search; neuroevolution; neuroevo-lution of augmented topologies; reinforcement learning; modular artificial neural networks; modular AI systems; artificial neural networks; neuro-evolution; artificial intelligence; autonomous agents; neuro-evolution of augmented topologies; novelty search; evolutionary computation; NEAT

Domaines: Intelligence artificielle [cs.AI]; Réseau de neurones [cs.NE]

Iaroslav Omelianenko. Creation of Autonomous Artificial Intelligent Agents using Novelty Search method of fitness function optimization. [Research Report] NewGround LLC. 2018. ⟨hal-01868756v2⟩