Weakly supervised object recognition with convolutional neural networks

Maxime Oquab (1, 2, 3) , Léon Bottou (4) , Ivan Laptev (2, 3) , Josef Sivic (2, 3)

1 MSR - INRIA - Microsoft Research - Inria Joint Centre
2 LIENS - Laboratoire d'informatique de l'école normale supérieure
3 WILLOW - Models of visual object recognition and scene understanding
4 Microsoft Research New York City

Successful visual object recognition methods typically rely on training datasets containing lots of richly annotated images. Annotating object bounding boxes is both expensive and subjective. We describe a weakly supervised convolutional neural network (CNN) for object recognition that does not rely on detailed object annotation and yet returns 86.3% mAP on the Pascal VOC classification task, outperforming previous fully-supervised systems by a sizable margin. Despite the lack of bounding box supervision, the network produces maps that clearly localize the objects in cluttered scenes. We also show that adding fully supervised object examples to our weakly supervised setup does not increase the classification performance.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Maxime Oquab, Léon Bottou, Ivan Laptev, Josef Sivic. Weakly supervised object recognition with convolutional neural networks. 2014. ⟨hal-01015140v1⟩