Linking Names and Faces: Seeing the Problem in Different Ways

Phi The Pham (1) , Marie-Francine Moens (1) , Tinne Tuytelaars (2)

1 CS - Department of Computer Science [Leuven]
2 ESAT - Department of Electrical Engineering [Leuven]

In this paper we report on our experiments on linking names and faces as found in images and captions of online news websites. Whereas previously, the focus has been mostly on assigning names to the faces, we generalize this framework, exploiting the (a)symmetry between the visual and textual modalities. This leads to different schemes for assigning names to faces, assigning faces to names, and establishing name-face link pairs. On top of that, we investigate the use of textual and visual structural information to predict the presence of the corresponding entity in the other modality. This further improves the accuracy of the cross-media linking results.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Phi The Pham, Marie-Francine Moens, Tinne Tuytelaars. Linking Names and Faces: Seeing the Problem in Different Ways. Workshop on Faces in 'Real-Life' Images: Detection, Alignment, and Recognition, Erik Learned-Miller and Andras Ferencz and Frédéric Jurie, Oct 2008, Marseille, France. ⟨inria-00326731⟩