Task-Driven Dictionary Learning

Julien Mairal 1, 2 Francis Bach 2, 3 Jean Ponce 1, 2
1 WILLOW - Models of visual object recognition and scene understanding
DI-ENS - Département d'informatique de l'École normale supérieure, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
3 SIERRA - Statistical Machine Learning and Parsimony
DI-ENS - Département d'informatique de l'École normale supérieure, ENS Paris - École normale supérieure - Paris, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
Abstract : Modeling data with linear combinations of a few elements from a learned dictionary has been the focus of much recent research in machine learning, neuroscience and signal processing. For signals such as natural images that admit such sparse representations, it is now well established that these models are well suited to restoration tasks. In this context, learning the dictionary amounts to solving a large-scale matrix factorization problem, which can be done efficiently with classical optimization tools. The same approach has also been used for learning features from data for other purposes, e.g., image classification, but tuning the dictionary in a supervised way for these tasks has proven to be more difficult. In this paper, we present a general formulation for supervised dictionary learning adapted to a wide variety of tasks, and present an efficient algorithm for solving the corresponding optimization problem. Experiments on handwritten digit classification, digital art identification, nonlinear inverse image problems, and compressed sensing demonstrate that our approach is effective in large-scale settings, and is well suited to supervised and semi-supervised classification, as well as regression tasks for data that admit sparse representations.
Document type :
Journal articles
Complete list of metadatas

Cited literature [55 references]  Display  Hide  Download

https://hal.inria.fr/inria-00521534
Contributor : Julien Mairal <>
Submitted on : Monday, September 9, 2013 - 9:01:36 AM
Last modification on : Thursday, February 7, 2019 - 2:25:55 PM
Long-term archiving on : Thursday, April 6, 2017 - 4:40:24 PM

Files

mairal_pami.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Julien Mairal, Francis Bach, Jean Ponce. Task-Driven Dictionary Learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2012, 34 (4), pp.30. ⟨10.1109/TPAMI.2011.156⟩. ⟨inria-00521534v2⟩

Share

Metrics

Record views

594

Files downloads

654