Random Forest for Dissimilarity-based Multi-view Learning

Simon Bernard (1) , Hongliu Cao (1) , Robert Sabourin (2) , Laurent Heutte (1)

1 DocApp - LITIS - Equipe Apprentissage
2 ETS - Ecole de Technologie Supérieure [Montréal]

Many classification problems are naturally multi-view in the sense their data are described through multiple heterogeneous descriptions. For such tasks, dissimilarity strategies are effective ways to make the different descriptions comparable and to easily merge them, by (i) building intermediate dissimilarity representations for each view and (ii) fusing these representations by averaging the dissimilarities over the views. In this work, we show that the Random Forest proximity measure can be used to build the dissimilarity representations, since this measure reflects similarities between features but also class membership. We then propose a Dynamic View Selection method to better combine the view-specific dis-similarity representations. This allows to take a decision, on each instance to predict, with only the most relevant views for that instance. Experiments are conducted on several real-world multi-view datasets, and show that the Dynamic View Selection offers a significant improvement in performance compared to the simple average combination and two state-of-the-art static view combinations.

Domaines: Apprentissage [cs.LG]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Simon Bernard, Hongliu Cao, Robert Sabourin, Laurent Heutte. Random Forest for Dissimilarity-based Multi-view Learning. Handbook of Pattern Recognition and Computer Vision, 6, World Scientific, pp.119-138, 2020, ⟨10.1142/9789811211072_0007⟩. ⟨hal-02892363⟩