Covariance Descriptors for 3D Shape Matching and Retrieval

Hedi Tabia 1 Hamid Laga 2 David Picard 1 Philippe-Henri Gosselin 3, 1
ETIS - Equipes Traitement de l'Information et Systèmes
3 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : Several descriptors have been proposed in the past for 3D shape analysis, yet none of them achieves best perfor- mance on all shape classes. In this paper we propose a novel method for 3D shape analysis using the covariance matrices of the descriptors rather than the descriptors them- selves. Covariance matrices enable efficient fusion of dif- ferent types of features and modalities. They capture, using the same representation, not only the geometric and the spa- tial properties of a shape region but also the correlation of these properties within the region. Covariance matrices, however, lie on the manifold of Symmetric Positive Defi- nite (SPD) tensors, a special type of Riemannian manifolds, which makes comparison and clustering of such matrices challenging. In this paper we study covariance matrices in their native space and make use of geodesic distances on the manifold as a dissimilarity measure. We demonstrate the performance of this metric on 3D face matching and recognition tasks. We then generalize the Bag of Features paradigm, originally designed in Euclidean spaces, to the Riemannian manifold of SPD matrices. We propose a new clustering procedure that takes into account the geometry of the Riemannian manifold. We evaluate the performance of the proposed Bag of Covariance Matrices framework on 3D shape matching and retrieval applications and demonstrate its superiority compared to descriptor-based techniques.
Document type :
Conference papers
Complete list of metadatas

Cited literature [40 references]  Display  Hide  Download
Contributor : Philippe-Henri Gosselin <>
Submitted on : Friday, July 11, 2014 - 12:25:38 PM
Last modification on : Friday, November 16, 2018 - 1:28:16 AM
Long-term archiving on : Saturday, October 11, 2014 - 12:05:38 PM


Files produced by the author(s)


  • HAL Id : hal-01022970, version 1


Hedi Tabia, Hamid Laga, David Picard, Philippe-Henri Gosselin. Covariance Descriptors for 3D Shape Matching and Retrieval. IEEE Conference on Computer Vsion and Pattern Recognition, Jun 2014, Columbus, Ohio, United States. 8 p. ⟨hal-01022970⟩



Record views


Files downloads