3D-CODED : 3D Correspondences by Deep Deformation

Thibault Groueix (1, 2) , Matthew Fisher (3) , Vladimir G Kim (4) , Bryan Russell (5) , Mathieu Aubry (1, 2)

1 LIGM - Laboratoire d'Informatique Gaspard-Monge
2 imagine [Marne-la-Vallée]
3 DIDE - Department of Infectious Disease Epidemiology [London]
4 Adobe Advanced Technology Labs - Adobe Systems Inc.
5 CSAIL - Computer Science and Artificial Intelligence Laboratory [Cambridge]

We present a new deep learning approach for matching deformable shapes by introducing Shape Deformation Networks which jointly encode 3D shapes and correspondences. This is achieved by factoring the surface representation into (i) a template, that parameterizes the surface, and (ii) a learnt global feature vector that parameterizes the transformation of the template into the input surface. By predicting this feature for a new shape, we implicitly predict correspondences between this shape and the template. We show that these correspondences can be improved by an additional step which improves the shape feature by minimizing the Chamfer distance between the input and transformed template. We demonstrate that our simple approach improves on state-of-the-art results on the difficult FAUST-inter challenge, with an average correspondence error of 2.88cm. We show, on the TOSCA dataset, that our method is robust to many types of perturbations, and generalizes to non-human shapes. This robustness allows it to perform well on real unclean, meshes from the the SCAPE dataset.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Intelligence artificielle [cs.AI]

Thibault Groueix, Matthew Fisher, Vladimir G Kim, Bryan Russell, Mathieu Aubry. 3D-CODED : 3D Correspondences by Deep Deformation. ECCV 2018, Sep 2018, Munich, Germany. ⟨hal-01830474v2⟩