Deep and Low-level Feature based Attribute Learning for Person Re-identification

Yiqiang Chen (1) , Stefan Duffner (1) , Andrei Stoian (2) , Jean-Yves Dufour (2) , Atilla Baskurt (1)

1 imagine - Extraction de Caractéristiques et Identification
2 Thales Services

In video surveillance, pedestrian attributes are defined as semantic descriptors like gender, clothing or accessories. In this paper, we propose a CNN-based pedestrian attribute-assisted person re-identification framework. First we perform the attribute learning by a part-specific CNN to model attribute patterns related to different body parts and fuse them with low-level robust Local Maximal Occurrence (LOMO) features to address the problem of the large variation of visual appearance and location of attributes due to different body poses and camera views. Our experiments on three public benchmarks show that the proposed method improves the state of the art on attribute recognition. Then we merge the learned attribute CNN embedding with another identification CNN embedding in a triplet structure to perform the person re-identification task. Both CNNs are pre-trained in a supervised way on attributes and person identities respectively, and then continue the training with a combined architecture for re-identification. We experimentally show that this fusion of "identity and attributes features" improves the overall re-identification.

Mots clés: Person re-identification; soft-biometrics; pedestrian attributes; convolutional neural network

Domaines: Informatique [cs]

Yiqiang Chen, Stefan Duffner, Andrei Stoian, Jean-Yves Dufour, Atilla Baskurt. Deep and Low-level Feature based Attribute Learning for Person Re-identification. Image and Vision Computing, 2018, 79, pp.25 - 34. ⟨10.1016/j.imavis.2018.09.001⟩. ⟨hal-01895367⟩