Seeing 3D chairs: exemplar part-based 2D-3D alignment using a large dataset of CAD models

Mathieu Aubry (1, 2, 3, 4) , Daniel Maturana (5) , Alexei Efros (5, 6) , Bryan C. Russell (7) , Josef Sivic (4)

1 LIGM - Laboratoire d'Informatique Gaspard-Monge
2 ENPC - École des Ponts ParisTech
3 imagine [Marne-la-Vallée]
4 WILLOW - Models of visual object recognition and scene understanding
5 CMU - Carnegie Mellon University [Pittsburgh]
6 LBNL - Lawrence Berkeley National Laboratory [Berkeley]
7 Intel Research Laboratory

This paper poses object category detection in images as a type of 2D-to-3D alignment problem, utilizing the large quantities of 3D CAD models that have been made publicly available online. Using the "chair" class as a running example, we propose an exemplar-based 3D category representation, which can explicitly model chairs of different styles as well as the large variation in viewpoint. We develop an approach to establish part-based correspondences between 3D CAD models and real photographs. This is achieved by (i) representing each 3D model using a set of view-dependent mid-level visual elements learned from synthesized views in a discriminative fashion, (ii) carefully calibrating the individual element detectors on a common dataset of negative images, and (iii) matching visual elements to the test image allowing for small mutual deformations but preserving the viewpoint and style constraints. We demonstrate the ability of our system to align 3D models with 2D objects in the challenging PASCAL VOC images, which depict a wide variety of chairs in complex scenes.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Mathieu Aubry, Daniel Maturana, Alexei Efros, Bryan C. Russell, Josef Sivic. Seeing 3D chairs: exemplar part-based 2D-3D alignment using a large dataset of CAD models. CVPR 2014 - Compter Vision and Pattern Recognition, Jun 2014, Colombus OH, United States. ⟨hal-01057240⟩