Population Control for Multi-agent Based Topical Crawlers

Alban Mouton (1) , Pierre-François Marteau (1)

1 VALORIA - Laboratoire de Recherche en Informatique et ses Applications de Vannes et Lorient

The use of multi-agent topical Web crawlers based on the endogenous fitness model raises the problem of controling the population of agents. We tackle this question through an energy based model to balance the reproduction/life expectency of agents. Our goal is to simplify the tuning of parameters and to optimize the use of ressources available for the crawling. We introduce an energy based model designed to control the number of agents according to the precision of the crawling. We present some experiments that show that the size of the population remains under control during the crawling.

Mots clés: population control; multi-agent; topical crawling; endogenous fitness

Domaines: Recherche d'information [cs.IR]

Alban Mouton, Pierre-François Marteau. Population Control for Multi-agent Based Topical Crawlers. International Conference on Intelligent Systems Design and Applications, Nov 2008, Kaohsiung, Taiwan. pp.133-137, ⟨10.1109/ISDA.2008.111⟩. ⟨hal-00497450⟩