Action Recognition from 3D Skeleton Sequences using Deep Networks on Lie Group Features

Manel Rhif (1) , Hazem Wannous (1) , Imed Riadh (2)

1 3D-SAM - Modeling and Analysis of Static and Dynamic Shapes
2 ISAMM - Institut Supérieur des Arts Multimédia de la Manouba

This paper addresses the problem of human action recognition from sequences of 3D skeleton data. For this purpose, we combine a deep learning network with geometric features extracted from data lie on a non-Euclidean space, which have been recently shown to be very effective to capture the geometric structure of the human pose. In particular, our approach claims to incorporate the intrinsic nature of the data characterized by Lie Group into deep neural networks and to learn more adequate geometric features for 3D action recognition problem. First, geometric features are extracted from 3D joints of skeleton sequences using the Lie group representation. Then, the network model is built from stacked units of 1-dimensional CNN across the temporal domain. Finally, CNN-features are then used to train an LSTM layer to model dependencies in the temporal domain, and to perform the action recognition. The experimental evaluation is performed on three public datasets containing various challenges: UT-Kinect, Florence 3D-Action and MSR-Action 3D. Results reveal that our approach achieves most of the state-of-the-art performance.

Mots clés: Deep Learning; Action recognition

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Interface homme-machine [cs.HC]

Manel Rhif, Hazem Wannous, Imed Riadh. Action Recognition from 3D Skeleton Sequences using Deep Networks on Lie Group Features. Accepted in International Conference on Pattern Recognition (ICPR), Aug 2018, Beijing, China. ⟨hal-01823804⟩