Fusion of appearance and motion-based sparse representations for multi-shot person re-identification

Mohamed Ibn Khedher (1, 2, 3) , Mounim El Yacoubi (4, 2, 3) , Bernadette Dorizzi (4, 1, 2, 3)

1 TSP - EPH - Département Electronique et Physique
2 SAMOVAR - Services répartis, Architectures, MOdélisation, Validation, Administration des Réseaux
3 CNRS - Centre National de la Recherche Scientifique
4 ARMEDIA-SAMOVAR - ARMEDIA

We present in this paper a multi-shot human re-identification system from video sequences based on interest points (IPs) matching. Our contribution is to take advantage of the complementary of person's appearance and style of its movement that leads to a more robust description with respect to various complexity factors. The proposed contributions include person's description and features matching. For person's description, we propose to exploit a fusion strategy of two complementary features provided by appearance and motion description. We describe motion using spatiotemporal IPs, and use spatial IPs for describing the appearance. For feature matching, we use Sparse Representation (SR) as a local matching method between IPs. The fusion strategy is based on the weighted sum of matched IPs votes and then applying the rule of majority vote. This approach is evaluated on a large public dataset, PRID-2011. The experimental results show that our approach clearly outperforms current state-of-the-art

Mots clés: Person re-identification; Fusion; Motion; Appearance; Sparse representation; Dynamic dictionary

Domaines: Apprentissage [cs.LG]; Traitement des images [eess.IV]

Mohamed Ibn Khedher, Mounim El Yacoubi, Bernadette Dorizzi. Fusion of appearance and motion-based sparse representations for multi-shot person re-identification. Neurocomputing, 2017, 248, pp.94 - 104. ⟨10.1016/j.neucom.2016.11.073⟩. ⟨hal-01587143⟩