Continuous gesture recognition from articulated poses

Georgios Evangelidis 1 Gurkirt Singh 2 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper addresses the problem of continuous gesture recognition from articulated poses. Unlike the common isolated recognition scenario, the gesture boundaries are here unknown, and one has to solve two problems: segmentation and recognition. This is cast into a labeling framework, namely every site (frame) must be assigned a label (gesture ID). The inherent constraint for a piece-wise constant labeling is satisfied by solving a global optimization problem with a smoothness term. For efficiency reasons, we suggest a dynamic programming (DP) solver that seeks the optimal path in a recursive manner. To quantify the consistency between the labels and the observations, we build on a recent method that encodes sequences of articulated poses into Fisher vectors using short skeletal descriptors. A sliding window allows to frame-wise build such Fisher vectors that are then classified by a multi-class SVM, whereby each label is assigned to each frame at some cost. The evaluation in the ChalearnLAP-2014 challenge shows that the method outperforms other participants that rely only on skeleton data. We also show that the proposed method competes with the top-ranking methods when colour and skeleton features are jointly used.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [39 references]  Display  Hide  Download
Contributor : Team Perception <>
Submitted on : Friday, November 14, 2014 - 5:25:08 PM
Last modification on : Wednesday, April 11, 2018 - 1:57:58 AM
Document(s) archivé(s) le : Monday, February 16, 2015 - 3:55:47 PM


Files produced by the author(s)




Georgios Evangelidis, Gurkirt Singh, Radu Horaud. Continuous gesture recognition from articulated poses. European Conference on Computer Vision Workshops, Sep 2014, Zurich, Switzerland. pp.595-607, ⟨10.1007/978-3-319-16178-5_42⟩. ⟨hal-01082981⟩



Record views


Files downloads