Skip to Main content Skip to Navigation
Conference papers

A Deep Learning Approach for Real-Time 3D Human Action Recognition from Skeletal Data

Abstract : We present a new deep learning approach for real-time 3D human action recognition from skeletal data and apply it to develop a vision-based intelligent surveillance system. Given a skeleton sequence, we propose to en- code skeleton poses and their motions into a single RGB image. An Adaptive Histogram Equalization (AHE) algorithm is then applied on the color images to enhance their local patterns and generate more discriminative features. For learning and classification tasks, we design Deep Neural Networks based on the Densely Connected Convolutional Architecture (DenseNet) to extract features from enhanced-color images and classify them into classes. Experi- mental results on two challenging datasets show that the proposed method reaches state-of-the-art accuracy, whilst requiring low computational time for training and inference. This paper also introduces CEMEST, a new RGB-D dataset depicting passenger behaviors in public transport. It consists of 203 untrimmed real-world surveillance videos of realistic normal and anomalous events. We achieve promising results on real conditions of this dataset with the support of data augmentation and transfer learning techniques. This enables the construction of real-world applications based on deep learning for enhancing monitoring and security in public transport.
Document type :
Conference papers
Complete list of metadata

Cited literature [51 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02883879
Contributor : Open Archive Toulouse Archive Ouverte (oatao) Connect in order to contact the contributor
Submitted on : Monday, June 29, 2020 - 2:58:51 PM
Last modification on : Wednesday, June 9, 2021 - 10:00:34 AM

File

Pham_26211.pdf
Files produced by the author(s)

Identifiers

Citation

Huy-Hieu Pham, Houssam Salmane, Louahdi Khoudour, Alain Crouzil, Pablo Zegers, et al.. A Deep Learning Approach for Real-Time 3D Human Action Recognition from Skeletal Data. 16th International Conference on Image Analysis and Recognition (ICIAR 2019can), Aug 2019, Waterloo, Canada. pp.18-32, ⟨10.1007/978-3-030-27202-9_2⟩. ⟨hal-02883879⟩

Share

Metrics

Record views

53

Files downloads

235