# Enhanced Line Search : A Novel Method to Accelerate PARAFAC

Abstract : Several modifications have been proposed to speed up the Alternating Least Squares (ALS) method of fitting the Parafac model. The most widely used is Line Search, which extrapolates from linear trends in the parameter changes over prior iterations to estimate the parameter values that would be obtained after many additional ALS iterations. We propose some extensions of this approach that incorporate a more sophisticated extrapolation, using information on nonlinear trends in the parameters and changing all the parameter sets simultaneously. The new method, called 'Enhanced Line Search', can be implemented at different levels of complexity, depending on how many different extrapolation parameters (for different modes) are jointly optimized during each iteration. We report some tests of the simplest parameter version, using simulated data. The performance of this lowest-level of ELS depends on the nature of the convergence difficulty. It significantly outperforms standard LS when there is a convergence bottleneck'', a situation where some modes have almost collinear factors but others do not, but is somewhat less effective in classic swamp'' situations where factors are highly collinear in all modes. This is illustrated by examples. To demonstrate how ELS can be adapted to different N-way decompositions, we also apply it to a four-way array to perform a Blind Identification of an Under-Determined Mixture (UDM). Since analysis of this dataset happens to involve a serious convergence bottleneck'' (collinear factors in two of the four modes), it provides another example of a situation in which ELS dramatically outperforms standard Line Search.
Keywords :
Type de document :
Article dans une revue
SIAM Journal on Matrix Analysis and Applications, Society for Industrial and Applied Mathematics, 2008, 30 (3), pp.1148-1171
Domaine :

https://hal.archives-ouvertes.fr/hal-00327595
Contributeur : Pierre Comon <>
Soumis le : mercredi 8 octobre 2008 - 21:13:15
Dernière modification le : lundi 4 décembre 2017 - 15:14:12
Document(s) archivé(s) le : jeudi 3 juin 2010 - 21:11:24

### Fichier

65537galleys3.pdf
Fichiers produits par l'(les) auteur(s)

### Identifiants

• HAL Id : hal-00327595, version 1

### Citation

Myriam Rajih, Pierre Comon, Richard Harshman. Enhanced Line Search : A Novel Method to Accelerate PARAFAC. SIAM Journal on Matrix Analysis and Applications, Society for Industrial and Applied Mathematics, 2008, 30 (3), pp.1148-1171. 〈hal-00327595〉

### Métriques

Consultations de la notice

## 324

Téléchargements de fichiers