A Unified Formalism for Video Descriptors

Olivier Kihl (1) , David Picard (1) , Philippe-Henri Gosselin (2, 3)

1 MIDI - Multimedia Indexation and Data Integration
2 ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes
3 TEXMEX - Multimedia content-based indexing

In this paper, we propose a unified formalism for video descriptors. This formalism is based on the descriptors decomposition in three levels: primitive, scattering and projection. With this framework, we are able to rewrite easily all the usual descriptors in the literature such as HOG, HOF, SURF. Then, we propose a new projection method based on approximation with a finite expansion of orthogonal polynomials. Using our framework, we extend all usual descrip- tors by switching the projection step. The experiments are carried out on the well known KTH dataset and on the more challenging Hollywood2 action classification dataset and show state of the art results.

Domains: Computer Vision and Pattern Recognition [cs.CV]

Olivier Kihl, David Picard, Philippe-Henri Gosselin. A Unified Formalism for Video Descriptors. IEEE Int. Conf. on Image Processing ICIP2013, Sep 2013, Melbourne, Australia. pp.2416-2419. ⟨hal-00832190v2⟩