Inducing and evaluating classification trees with statistical implicative criteria

Gilbert Ritschard , Vincent Pisetta (1) , Djamel Abdelkader Zighed (1)

1 ERIC - Equipe de Recherche en Ingénierie des Connaissances

Implicative statistics criteria have proven to be valuable interestingness measures for association rules. Here we highlight their interest for classification trees. We start by showing how Gras' implication index may be defined for rules derived from an induced decision tree. This index is especially helpful when the aim is not classification itself, but characterizing the most typical conditions of a given conclusion. We show that the index looks like a standardized residual and propose as alternatives other forms of residuals borrowed from the modeling of contingency tables. We then consider two main usages of these indexes. The first is purely descriptive and concerns the a posteriori individual evaluation of the classification rules. The second usage relies upon the strength of implication for assigning the most appropriate conclusion to each leaf of the induced tree. We demonstrate the practical usefulness of this statistical implicative view on decision trees through a full scale real world application.

Mots clés: Classification tree; Implication strength; Class assignment; Rule relevance; Profile typicality; Targeting

Domaines: Machine Learning [stat.ML]; Bio-informatique [q-bio.QM]; Bio-Informatique, Biologie Systémique [q-bio.QM]; Applications [stat.AP]; Statistiques [math.ST]; Théorie [stat.TH]; Topologie géométrique [math.GT]

Gilbert Ritschard, Vincent Pisetta, Djamel Abdelkader Zighed. Inducing and evaluating classification trees with statistical implicative criteria. Statistical Implicative Analysis : Theory and Applications, 2008, France. pp.397-419, ⟨10.1007/978-3-540-78983-3_18⟩. ⟨hal-00519611⟩