Spatio-temporal information fusion for human action recognition in videos

Emmanuel Ramasso (1) , Denis Pellerin (1) , Costas Panagiotakis (2) , Michèle Rombaut (1) , Georgios Tziritas (2) , William Lim (1)

1 LIS - Laboratoire des images et des signaux
2 CSD-UOC - Computer Science Department [Crete]

Many applications are concerned by human action recognition notably in multimedia and more particularly for video retrieval and archival. Usual approaches focus on probabilistic methods and assume a still camera. In this paper, a method based on the Transferable Belief Model fusion process and considering a moving camera is proposed. In this framework, the affine camera motion estimation and temporal variations of three major human points are combined. The method is tested on videos of athletics meetings in which running, jumping and falling actions have to be recognized. Results show the validity of the method for action recognition.

Mots clés: Human motion analysis; human action recognition; Transferable Belief Model

Domaines: Multimédia [cs.MM]

Emmanuel Ramasso, Denis Pellerin, Costas Panagiotakis, Michèle Rombaut, Georgios Tziritas, et al.. Spatio-temporal information fusion for human action recognition in videos. 13th European Signal Processing Conference (EUSIPCO'05), 2005, Antalya, Turkey. ⟨hal-00068014⟩