Majority Vote of Diverse Classifiers for Late Fusion

Emilie Morvant 1 Amaury Habrard 2 Stéphane Ayache 3
1 Lampert Group
IST Austria - Institute of Science and Technology [Austria]
3 QARMA - éQuipe AppRentissage et MultimediA [Marseille]
LIF - Laboratoire d'informatique Fondamentale de Marseille
Abstract : In the past few years, a lot of attention has been devoted to multimedia indexing by fusing multimodal informations. Two kinds of fusion schemes are generally considered: The early fusion and the late fusion. We focus on late classifier fusion, where one combines the scores of each modality at the decision level. To tackle this problem, we investigate a recent and elegant well-founded quadratic program named MinCq coming from the machine learning PAC-Bayesian theory. MinCq looks for the weighted combination, over a set of real-valued functions seen as voters, leading to the lowest misclassification rate, while maximizing the voters' diversity. We propose an extension of MinCq tailored to multimedia indexing. Our method is based on an order-preserving pairwise loss adapted to ranking that allows us to improve Mean Averaged Precision measure while taking into account the diversity of the voters that we want to fuse. We provide evidence that this method is naturally adapted to late fusion procedures and confirm the good behavior of our approach on the challenging PASCAL VOC'07 benchmark.
Complete list of metadatas
Contributor : Emilie Morvant <>
Submitted on : Wednesday, June 18, 2014 - 2:58:27 PM
Last modification on : Tuesday, April 2, 2019 - 1:41:43 AM
Long-term archiving on : Thursday, September 18, 2014 - 11:10:57 AM


Files produced by the author(s)


  • HAL Id : hal-00985839, version 2
  • ARXIV : 1404.7796


Emilie Morvant, Amaury Habrard, Stéphane Ayache. Majority Vote of Diverse Classifiers for Late Fusion. IAPR Joint International Workshops on Statistical Techniques in Pattern Recognition and Structural and Syntactic Pattern Recignition, Aug 2014, Joensuu, Finland. pp.20. ⟨hal-00985839v2⟩



Record views


Files downloads