The CAMOMILE Collaborative Annotation Platform for Multi-modal, Multi-lingual and Multi-media Documents

Johann Poignant (1, 2) , Mateusz Budnik (3) , Hervé Bredin (2) , Claude Barras (2) , Mickael Stefas (4) , Pierrick Bruneau (4) , Gilles Adda (2, 5) , Laurent Besacier (6, 7) , Hazim Ekenel (8) , Gil Francopoulo (5) , Javier Hernando (9) , Joseph Mariani (5) , Ramon Morros (9) , Georges Quénot (3) , Sophie Rosset (2) , Thomas Tamisier (4)

1 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]
2 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur
3 LIG - Laboratoire d'Informatique de Grenoble
4 Centre de Recherche Public - Gabriel Lippmann (LUXEMBOURG)
5 IMMI - Institut des Technologies Multilingues et Multimédias de l'Information
6 GETALP - Groupe d’Étude en Traduction Automatique/Traitement Automatisé des Langues et de la Parole
7 IUF - Institut universitaire de France
8 Istanbul University
9 UPC - Universitat Politècnica de Catalunya = Université polytechnique de Catalogne [Barcelona]

In this paper, we describe the organization and the implementation of the CAMOMILE collaborative annotation framework for multimodal, multimedia, multilingual (3M) data. Given the versatile nature of the analysis which can be performed on 3M data, the structure of the server was kept intentionally simple in order to preserve its genericity, relying on standard Web technologies. Layers of annotations, defined as data associated to a media fragment from the corpus, are stored in a database and can be managed through standard interfaces with authentication. Interfaces tailored specifically to the needed task can then be developed in an agile way, relying on simple but reliable services for the management of the centralized annotations. We then present our implementation of an active learning scenario for person annotation in video, relying on the CAMOMILE server; during a dry run experiment, the manual annotation of 716 speech segments was thus propagated to 3504 labeled tracks. The code of the CAMOMILE framework is distributed in open source.

Mots clés: Annotation tool; collaborative annotation; multimedia; active learning; person annotation

Domaines: Informatique et langage [cs.CL]

Johann Poignant, Mateusz Budnik, Hervé Bredin, Claude Barras, Mickael Stefas, et al.. The CAMOMILE Collaborative Annotation Platform for Multi-modal, Multi-lingual and Multi-media Documents. LREC 2016 Conference, May 2016, Portoroz, Slovenia. ⟨hal-01350096⟩