Relating Leverage Scores and Density using Regularized Christoffel Functions

Abstract : Statistical leverage scores emerged as a fundamental tool for matrix sketching and column sampling with applications to low rank approximation, regression, random feature learning and quadrature. Yet, the very nature of this quantity is barely understood. Borrowing ideas from the orthogonal polynomial literature, we introduce the regularized Christoffel function associated to a positive definite kernel. This uncovers a variational formulation for leverage scores for kernel methods and allows to elucidate their relationships with the chosen kernel as well as population density. Our main result quantitatively describes a decreasing relation between leverage score and population density for a broad class of kernels on Euclidean spaces. Numerical simulations support our findings.
Type de document :
Pré-publication, Document de travail
2018
Liste complète des métadonnées

Littérature citée [35 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01796591
Contributeur : Edouard Pauwels <>
Soumis le : lundi 21 mai 2018 - 10:49:59
Dernière modification le : mercredi 12 septembre 2018 - 17:46:04
Document(s) archivé(s) le : mardi 25 septembre 2018 - 11:40:26

Fichier

christoffelLeverageScore.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01796591, version 1

Citation

Edouard Pauwels, Francis Bach, Jean-Philippe Vert. Relating Leverage Scores and Density using Regularized Christoffel Functions. 2018. 〈hal-01796591〉

Partager

Métriques

Consultations de la notice

264

Téléchargements de fichiers

70