A diffusion strategy for distributed dictionary learning

Pierre Chainais 1, 2, 3, 4 Cédric Richard 5
3 LAGIS-SI
LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal
4 SEQUEL - Sequential Learning
LIFL - Laboratoire d'Informatique Fondamentale de Lille, LAGIS - Laboratoire d'Automatique, Génie Informatique et Signal, Inria Lille - Nord Europe
Abstract : We consider the problem of a set of nodes which is required to collectively learn a common dictionary from noisy measurements. This distributed dictionary learning approach may be useful in several contexts including sensor networks. Dif-fusion cooperation schemes have been proposed to estimate a consensus solution to distributed linear regression. This work proposes a diffusion-based adaptive dictionary learning strategy. Each node receives measurements which may be shared or not with its neighbors. All nodes cooperate with their neighbors by sharing their local dictionary to estimate a common representa-tion. In a diffusion approach, the resulting algorithm corresponds to a distributed alternate optimization. Beyond dictionary learn-ing, this strategy could be adapted to many matrix factorization problems in various settings. We illustrate its efficiency on some numerical experiments, including the difficult problem of blind hyperspectral images unmixing.
Complete list of metadatas

Cited literature [8 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01104781
Contributor : Pierre Chainais <>
Submitted on : Monday, January 19, 2015 - 11:20:42 AM
Last modification on : Friday, October 4, 2019 - 8:14:01 AM
Long-term archiving on : Monday, April 20, 2015 - 10:36:33 AM

File

Chainais_itwist14_paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01104781, version 1
  • ARXIV : 1410.0719

Citation

Pierre Chainais, Cédric Richard. A diffusion strategy for distributed dictionary learning. 2nd "international Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST'14), Laurent Jacques, Aug 2014, Namur, Belgium. ⟨hal-01104781⟩

Share

Metrics

Record views

631

Files downloads

246