Fast Selection of Spectral Variables with B-Spline Compression

Abstract : The large number of spectral variables in most data sets encountered in spectral chemometrics often renders the prediction of a dependent variable uneasy. The number of variables hopefully can be reduced, by using either projection techniques or selection methods; the latter allow for the interpretation of the selected variables. Since the optimal approach of testing all possible subsets of variables with the prediction model is intractable, an incremental selection approach using a nonparametric statistics is a good option, as it avoids the computationally intensive use of the model itself. It has two drawbacks however: the number of groups of variables to test is still huge, and colinearities can make the results unstable. To overcome these limitations, this paper presents a method to select groups of spectral variables. It consists in a forward-backward procedure applied to the coefficients of a B-Spline representation of the spectra. The criterion used in the forward-backward procedure is the mutual information, allowing to find nonlinear dependencies between variables, on the contrary of the generally used correlation. The spline representation is used to get interpretability of the results, as groups of consecutive spectral variables will be selected. The experiments conducted on NIR spectra from fescue grass and diesel fuels show that the method provides clearly identified groups of selected variables, making interpretation easy, while keeping a low computational load. The prediction performances obtained using the selected coefficients are higher than those obtained by the same method applied directly to the original variables and similar to those obtained using traditional models, although using significantly less spectral variables.
Type de document :
Article dans une revue
Chemometrics and Intelligent Laboratory Systems / I Mathematical Background Chemometrics Intell Lab Syst, 2007, 86 (2), pp.208-218. <10.1016/j.chemolab.2006.06.007>
Liste complète des métadonnées

https://hal.inria.fr/inria-00174299
Contributeur : Fabrice Rossi <>
Soumis le : dimanche 23 septembre 2007 - 15:52:35
Dernière modification le : mardi 9 octobre 2007 - 11:30:12
Document(s) archivé(s) le : vendredi 9 avril 2010 - 02:41:33

Fichiers

bsplines-im.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Fabrice Rossi, Damien François, Vincent Wertz, Marc Meurens, Michel Verleysen. Fast Selection of Spectral Variables with B-Spline Compression. Chemometrics and Intelligent Laboratory Systems / I Mathematical Background Chemometrics Intell Lab Syst, 2007, 86 (2), pp.208-218. <10.1016/j.chemolab.2006.06.007>. <inria-00174299>

Partager

Métriques

Consultations de
la notice

349

Téléchargements du document

167