Distances evolution analysis for online and off-line human object interaction recognition

Meng Meng (1) , Hassen Drira (2) , Jacques Boonaert (3)

1 TUST - Tianjin University of Science and Technology
2 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
3 CERI SN - IMT Nord Europe - Centre for Digital Systems

Human action recognition in 3D sequences is one of the most challenging and active areas of research in the computer vision domain. However designing automatic systems that are robust to significant variability due to object combinations and high complexity of human motions are more challenging in addition to the typical requirements such as rotation, translation, and scale invariance is challenging task. In this paper, we propose a spatio-temporal modeling of human-object interaction videos for on-line and off-line recognition. The inter joint distances and the object are considered as low-level features for online classification. For off-line recognition, we propose rate-invariant classification of full video and early recognition. A shape analysis of trajectories of the inter-joint and object-joints distances is proposed for this end. The experiments conducted following state-of-the-art settings using MSR Daily Activity 3D Dataset and On-line RGBD Action Dataset and on a new Multi-view dataset for human object interaction demonstrate that the proposed approach is effective and discrimina-tive for human object interaction classification as demonstrated here.

Mots clés: Human object interaction; rate invariance; shape analysis; temporal modeling

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Meng Meng, Hassen Drira, Jacques Boonaert. Distances evolution analysis for online and off-line human object interaction recognition. Image and Vision Computing, 2017. ⟨hal-01703179⟩