HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Modeling Inter and Intra-Class Relations in the Triplet Loss for Zero-Shot Learning

Abstract : Recognizing visual unseen classes, i.e. for which no training data is available, is known as Zero Shot Learning (ZSL). Some of the best performing methods apply the triplet loss to seen classes to learn a mapping between visual representations of images and attribute vectors that constitute class prototypes. They nevertheless make several implicit assumptions that limit their performance on real use cases, particularly with fine-grained datasets comprising a large number of classes. We identify three of these assumptions and put forward corresponding novel contributions to address them. Our approach consists in taking into account both inter-class and intra-class relations, respectively by being more permissive with confusions between similar classes, and by penalizing visual samples which are atypical to their class. The approach is tested on four datasets, including the large-scale ImageNet, and exhibits performances significantly above recent methods, even gen-erative methods based on more restrictive hypotheses.
Complete list of metadata

Cited literature [42 references]  Display  Hide  Download

Contributor : Herve Le Borgne Connect in order to contact the contributor
Submitted on : Monday, January 20, 2020 - 3:13:12 PM
Last modification on : Tuesday, February 22, 2022 - 3:13:25 AM
Long-term archiving on: : Tuesday, April 21, 2020 - 12:51:56 PM


Files produced by the author(s)





Yannick Le Cacheux, Hervé Le Borgne, Michel Crucianu. Modeling Inter and Intra-Class Relations in the Triplet Loss for Zero-Shot Learning. IEEE International Conference on Computer Vision, Oct 2019, Séoul, South Korea. ⟨10.1109/ICCV.2019.01043⟩. ⟨hal-02440364⟩



Record views


Files downloads