Evaluation of local spatio-temporal features for action recognition

Heng Wang 1, 2 Muhammad Muneeb Ullah 3 Alexander Klaser 1 Ivan Laptev 3 Cordelia Schmid 1
1 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 LIAMA - Pattern
3 VISTAS - Spatio-Temporal Vision and Learning
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : Local space-time features have recently become a popular video representation for action recognition. Several methods for feature localization and description have been proposed in the literature and promising recognition results were demonstrated for a number of action classes. The comparison of existing methods, however, is often limited given the different experimental settings used. The purpose of this paper is to evaluate and compare previously proposed space-time features in a common experimental setup. In particular, we consider four different feature detectors and six local feature descriptors and use a standard bag-of-features SVM approach for action recognition. We investigate the performance of these methods on a total of 25 action classes distributed over three datasets with varying difficulty. Among interesting conclusions, we demonstrate that regular sampling of space-time features consistently outperforms all tested space-time interest point detectors for human actions in realistic settings. We also demonstrate a consistent ranking for the majority of methods over different datasets and discuss their advantages and limitations.
Keywords : descriptor evaluation action recognition classification SVM BOW BOF 3D videos KTH Hollywood2 Hollywood UCF sports
Type de document :
Communication dans un congrès
A. Cavallaro and S. Prince and D. Alexander. BMVC 2009 - British Machine Vision Conference, Sep 2009, London, United Kingdom. BMVA Press, pp.124.1-124.11, 2009, <10.5244/C.23.124>
Liste complète des métadonnées

01_interest_points_kth.png
01_interest_points_kth.png
https://hal.inria.fr/inria-00439769
Contributeur : Thoth Team <>
Soumis le : vendredi 8 avril 2011 - 14:18:13
Dernière modification le : jeudi 2 février 2017 - 15:59:03
Document(s) archivé(s) le : jeudi 8 novembre 2012 - 15:45:41

Fichiers

paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

INRIA | LIAMA | IRISA | CIRAD | LJK_GI_LEAR | LJK | LJK_GI | UGA | INRA | UR1-UFR-ISTIC

Citation

Heng Wang, Muhammad Muneeb Ullah, Alexander Klaser, Ivan Laptev, Cordelia Schmid. Evaluation of local spatio-temporal features for action recognition. A. Cavallaro and S. Prince and D. Alexander. BMVC 2009 - British Machine Vision Conference, Sep 2009, London, United Kingdom. BMVA Press, pp.124.1-124.11, 2009, <10.5244/C.23.124>. <inria-00439769>

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de
la notice

4041

Téléchargements du document

3370

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD