Continuous gesture recognition from articulated poses

Georgios Evangelidis 1 Gurkirt Singh 2 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper addresses the problem of continuous gesture recognition from articulated poses. Unlike the common isolated recognition scenario, the gesture boundaries are here unknown, and one has to solve two problems: segmentation and recognition. This is cast into a labeling framework, namely every site (frame) must be assigned a label (gesture ID). The inherent constraint for a piece-wise constant labeling is satisfied by solving a global optimization problem with a smoothness term. For efficiency reasons, we suggest a dynamic programming (DP) solver that seeks the optimal path in a recursive manner. To quantify the consistency between the labels and the observations, we build on a recent method that encodes sequences of articulated poses into Fisher vectors using short skeletal descriptors. A sliding window allows to frame-wise build such Fisher vectors that are then classified by a multi-class SVM, whereby each label is assigned to each frame at some cost. The evaluation in the ChalearnLAP-2014 challenge shows that the method outperforms other participants that rely only on skeleton data. We also show that the proposed method competes with the top-ranking methods when colour and skeleton features are jointly used.
Type de document :
Communication dans un congrès
European Conference on Computer Vision Workshops, Sep 2014, Zurich, Switzerland. pp.595-607, 2014, 〈http://link.springer.com/chapter/10.1007/978-3-319-16178-5_42〉. 〈10.1007/978-3-319-16178-5_42〉
Liste complète des métadonnées

Littérature citée [39 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01082981
Contributeur : Team Perception <>
Soumis le : vendredi 14 novembre 2014 - 17:25:08
Dernière modification le : mercredi 11 avril 2018 - 01:57:58
Document(s) archivé(s) le : lundi 16 février 2015 - 15:55:47

Fichiers

ECCVW2014.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Georgios Evangelidis, Gurkirt Singh, Radu Horaud. Continuous gesture recognition from articulated poses. European Conference on Computer Vision Workshops, Sep 2014, Zurich, Switzerland. pp.595-607, 2014, 〈http://link.springer.com/chapter/10.1007/978-3-319-16178-5_42〉. 〈10.1007/978-3-319-16178-5_42〉. 〈hal-01082981〉

Partager

Métriques

Consultations de la notice

1038

Téléchargements de fichiers

804