PAC-Bayesian Majority Vote for Late Classifier Fusion

Abstract : A lot of attention has been devoted to multimedia indexing over the past few years. In the literature, we often consider two kinds of fusion schemes: The early fusion and the late fusion. In this paper we focus on late classifier fusion, where one combines the scores of each modality at the decision level. To tackle this problem, we investigate a recent and elegant well-founded quadratic program named MinCq coming from the Machine Learning PAC-Bayes theory. MinCq looks for the weighted combination, over a set of real-valued functions seen as voters, leading to the lowest misclassification rate, while making use of the voters' diversity. We provide evidence that this method is naturally adapted to late fusion procedure. We propose an extension of MinCq by adding an order- preserving pairwise loss for ranking, helping to improve Mean Averaged Precision measure. We confirm the good behavior of the MinCq-based fusion approaches with experiments on a real image benchmark.
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00714483
Contributor : Emilie Morvant <>
Submitted on : Wednesday, July 4, 2012 - 4:49:07 PM
Last modification on : Tuesday, April 2, 2019 - 1:43:35 AM
Long-term archiving on : Friday, October 5, 2012 - 4:27:08 AM

Files

main_FusMinCq.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00714483, version 1
  • ARXIV : 1207.1019

Citation

Emilie Morvant, Amaury Habrard, Stéphane Ayache. PAC-Bayesian Majority Vote for Late Classifier Fusion. [Research Report] LIF Marseille; LaHC Saint-Etienne. 2012. ⟨hal-00714483⟩

Share

Metrics

Record views

362

Files downloads

172