Human action recognition in videos based on the Transferable Belief Model

Emmanuel Ramasso (1) , Costas Panagiotakis (2) , Denis Pellerin (1) , Michèle Rombaut (1)

1 GIPSA-GPIG - GIPSA - Géométrie, Perception, Images, Geste
2 CSD-UOC - Computer Science Department [Crete]

This paper focuses on human behavior recognition where the main problem is to bridge the semantic gap between the analogue observations of the real world and the symbolic world of human interpretation. For that, a fusion architecture based on the Transferable Belief Model framework is proposed and applied to action recognition of an athlete in video sequences of athletics meeting with moving camera. Relevant features are extracted from videos based on both the camera motion analysis and the tracking of particular points on athlete's silhouette. Some models of interpretation are used to link the numerical features to the symbols to be recognized which are running, jumping and falling actions. A Temporal Belief Filter is then used to improve the robustness of action recognition. The proposed approach demonstrates good performance when tested on real videos of athletics sports videos (high jumps, pole vaults, triple jumps and long jumps) acquired by moving camera and varying view angles. The proposed system is also compared to Bayesian Networks.

Mots clés: Temporal Belief Filter; Moving camera; Human action recognition; Transferable Belief Model

Domaines: Multimédia [cs.MM]; Systèmes dynamiques [math.DS]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Emmanuel Ramasso, Costas Panagiotakis, Denis Pellerin, Michèle Rombaut. Human action recognition in videos based on the Transferable Belief Model. Pattern Analysis and Applications, 2008, 11 (1), pp.1-19. ⟨10.1007/s10044-007-0073-y⟩. ⟨hal-00140361⟩