Caveats with stochastic gradient and maximum likelihood based ICA for EEG

Jair Montoya-Martínez (1, 2, 3, 4) , Jean-François Cardoso (1, 2, 3, 4) , Alexandre Gramfort (1, 2, 3, 4)

1 LTCI - Laboratoire Traitement et Communication de l'Information
2 Université Paris-Saclay
3 CNRS - Centre National de la Recherche Scientifique
4 Télécom ParisTech

Stochastic gradient (SG) is the most commonly used optimization technique for maximum likelihood based approaches to independent component analysis (ICA). It is in particular the default solver in public implementations of Infomax and variants. Motivated by experimental findings on electroencephalography (EEG) data, we report some caveats which can impact the results and interpretation of neuroscience findings. We investigate issues raised by controlling the step size in gradient updates combined with early stopping conditions, as well as initialization choices which can artificially generate biologically plausible brain sources, so called dipolar sources. We provide experimental evidence that pushing the convergence of Infomax using non stochastic solvers can reduce the number of highly dipolar components and provide a mathematical explanation of this fact. Results are presented on public EEG data.

Mots clés: Independent component analysis (ICA); maximum likelihood; stochastic gradient method; infomax; electroencephalography (EEG); neuroscience

Domaines: Neurosciences; Apprentissage [cs.LG]

Jair Montoya-Martínez, Jean-François Cardoso, Alexandre Gramfort. Caveats with stochastic gradient and maximum likelihood based ICA for EEG. Latent Variable Analysis, Independent Component Analysis LVA-ICA International Conference, Feb 2017, Grenoble, France. ⟨hal-01451432⟩