Context Aware Group Activity Recognition - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Context Aware Group Activity Recognition

Résumé

This paper addresses the task of group activity recognition in multi-person videos. Existing approaches decompose this task into feature learning and relational reasoning. Despite showing progress, these methods only rely on appearance features for people and overlook the available contextual information, which can play an important role in group activity understanding. In this work, we focus on the feature learning aspect and propose a two-stream architecture that not only considers person-level appearance features, but also makes use of contextual information present in videos for group activity recognition. In particular, we propose to use two types of contextual information beneficial for two different scenarios: pose context and scene context that provide crucial cues for group activity understanding. We combine appearance and contextual features to encode each person with an enriched representation. Finally, these combined features are used in relational reasoning for predicting group activities. We evaluate our method on two benchmarks, Volleyball and Collective Activity and show that joint modeling of contextual information with appearance features benefits in group activity understanding.
Fichier principal
Vignette du fichier
paper-cameraready.pdf (3.99 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02987414 , version 1 (03-11-2020)

Identifiants

Citer

Avijit Dasgupta, C. V. Jawahar, Karteek Alahari. Context Aware Group Activity Recognition. ICPR 2020 - International Conference on Pattern Recognition, Jan 2021, Milan (Virtual), Italy. pp.10098-10105, ⟨10.1109/ICPR48806.2021.9412306⟩. ⟨hal-02987414⟩
283 Consultations
289 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More