Recognizing and localizing individual activities through graph matching

Anh Phuong Ta 1 Christian Wolf 1, 2 Guillaume Lavoué 1 Atilla Baskurt 1, 2
1 M2DisCo - Geometry Processing and Constrained Optimization
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : In this paper we tackle the problem of detecting individual human actions in video sequences. While the most successful methods are based on local features, which proved that they can deal with changes in background, scale and illumination, most existing methods have two main shortcomings: first, they are mainly based on the individual power of spatio-temporal interest points (STIP), and therefore ignore the spatio-temporal relationships between them. Second, these methods mainly focus on direct classification techniques to classify the human activities, as opposed to detection and localization. In order to overcome these limitations, we propose a new approach, which is based on a graph matching algorithm for activity recognition. In contrast to most previous methods which classify entire video sequences, we design a video matching method from two sets of ST-points for human activity recognition. First, points are extracted, and a hyper graphs are constructed from them, i.e. graphs with edges involving more than 2 nodes (3 in our case). The activity recognition problem is then transformed into a problem of finding instances of model graphs in the scene graph. By matching local features instead of classifying entire sequences, our method is able to detect multiple different activities which occur simultaneously in a video sequence. Experiments on two standard datasets demonstrate that our method is comparable to the existing techniques on classification, and that it can, additionally, detect and localize activities.
Document type :
Conference papers
Complete list of metadatas
Contributor : Équipe Gestionnaire Des Publications Si Liris <>
Submitted on : Friday, October 14, 2016 - 2:47:29 PM
Last modification on : Monday, December 10, 2018 - 5:47:41 PM

Links full text



Anh Phuong Ta, Christian Wolf, Guillaume Lavoué, Atilla Baskurt. Recognizing and localizing individual activities through graph matching. International Conference on Advanced Video and Signal-Based Surveillance (BEST PAPER), Aug 2010, Boston, United States. pp.196-203, ⟨10.1109/AVSS.2010.81⟩. ⟨hal-01381516⟩



Record views