Relative Dense Tracklets for Human Action Recognition

Piotr Bilinski (1) , Etienne Corvee (1) , Slawomir Bak (1) , Francois Bremond (1)

1 STARS - Spatio-Temporal Activity Recognition Systems

This paper addresses the problem of recognizing human actions in video sequences for home care applications. Recent studies have shown that approaches which use a bag-of-words representation reach high action recognition accuracy. Unfortunately, these approaches have problems to discriminate similar actions, ignoring spatial information of features. As we focus on recognizing subtle differences in behaviour of patients, we propose a novel method which significantly enhances the discriminative properties of the bag-of-words technique. Our approach is based on a dynamic coordinate system, which introduces spatial information to the bag-of-words model, by computing relative tracklets. We perform an extensive evaluation of our approach on three datasets: popular KTH dataset, challenging ADL dataset and our collected Hospital dataset. Experiments show that our representation enhances the discriminative power of features and bag-of-words model, bringing significant improvements in action recognition performance.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Piotr Bilinski, Etienne Corvee, Slawomir Bak, Francois Bremond. Relative Dense Tracklets for Human Action Recognition. 10th IEEE International Conference on Automatic Face and Gesture Recognition, Apr 2013, Shanghai, China. pp.1-7, ⟨10.1109/FG.2013.6553699⟩. ⟨hal-00806321⟩