Real-time unsupervised classification of web documents

Anthony Sigogne (1) , Mathieu Constant (1)

1 LIGM - Laboratoire d'Informatique Gaspard-Monge

This paper adresses the problem of clustering dynamic collections of web documents. We show an iterative algorithm based on a fine-grained keyword extraction (simple, compound words and proper nouns). Each new document inserted in the collection is either assigned to an existing class containing documents of the same topic, or assigned to a new class. After each step, when necessary, classes are refined using statistical techniques. The implementation of this algorithm was successfully integrated in an application used for Information Intelligence.

Mots clés: web mining; keyword extraction; clustering

Domaines: Informatique et langage [cs.CL]

Anthony Sigogne, Mathieu Constant. Real-time unsupervised classification of web documents. 4th International Multiconference on Computer Science and Information Technology (IMCSIT'09), Oct 2009, Mragowo, Poland. pp.281-286, ⟨10.1109/IMCSIT.2009.5352714⟩. ⟨hal-00722749⟩