J. Nocedal and S. J. Wright, Numerical Optimization, 1999.
DOI : 10.1007/b98874

P. L. Combettes and J. Pesquet, Proximal splitting methods in signal processing, " in Fixed-Point Algorithms for Inverse Problems in Science and Engineering, pp.185-212, 2010.

M. V. Afonso, J. M. Bioucas-dias, and M. A. Figueiredo, An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems, IEEE Transactions on Image Processing, vol.20, issue.3, pp.681-695, 2011.
DOI : 10.1109/TIP.2010.2076294

M. Zibulevsky and M. Elad, L1-L2 Optimization in Signal and Image Processing, IEEE Signal Processing Magazine, vol.27, issue.3, pp.76-88, 2010.
DOI : 10.1109/MSP.2010.936023

URL : https://hal.archives-ouvertes.fr/inria-00567455

E. Chouzenoux, J. Idier, and S. Moussaoui, A Majorize–Minimize Strategy for Subspace Optimization Applied to Image Restoration, IEEE Transactions on Image Processing, vol.20, issue.6, pp.1517-1528, 2011.
DOI : 10.1109/TIP.2010.2103083

E. Chouzenoux, A. Jezierska, J. Pesquet, H. A. Talbot, E. Florescu et al., A Majorize-Minimize Subspace Approach for $\ell_2-\ell_0$ Image Regularization, Special issue on Image Restoration and Enhancement: Recent Advances and Applications, pp.563-591, 2013.
DOI : 10.1137/11085997X

S. O. Haykin, Adaptive Filter Theory, 2002.

L. Bottou, Stochastic Learning, Advanced Lectures on Machine Learning, pp.146-168, 2004.
DOI : 10.1007/978-1-4757-2440-0

B. T. Polyak and A. B. Juditsky, Acceleration of Stochastic Approximation by Averaging, SIAM Journal on Control and Optimization, vol.30, issue.4, pp.838-855, 1992.
DOI : 10.1137/0330046

F. Bach and E. Moulines, Non-asymptotic analysis of stochastic approximation algorithms for machine learning, Proc
URL : https://hal.archives-ouvertes.fr/hal-00608041

C. Paleologu, J. Benesty, and S. , Ciochin? a, Sparse adaptive filters for echo cancellation, Synthesis Lectures on Speech and Audio Processing, 2010.

Y. Murakami, M. Yamagishi, M. Yukawa, and I. Yamada, A sparse adaptive filtering using time-varying soft-thresholding techniques, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.3734-3737, 2010.
DOI : 10.1109/ICASSP.2010.5495870

D. Angelosante, J. A. Bazerque, and G. Giannakis, Online adaptive estimation of sparse signals: where RLS meets the ?1 -norm, IEEE Trans. Signal Process, pp.3436-3447, 2010.

L. Xiao, Dual averaging methods for regularized stochastic learning and online optimization, J. Mach. Learn. Res, vol.11, pp.2543-2596, 2010.

J. R. Birge, X. Chen, L. Qi, and Z. Wei, A stochastic Newton method for stochastic quadratic programs with recourse, technical report, 1995.

A. Bordes, L. Bottou, and P. Gallinari, SGD-QN: Careful quasi-Newton stochastic gradient descent, J. Mach. Learn. Res, vol.10, pp.1737-1754, 2009.
URL : https://hal.archives-ouvertes.fr/hal-00750911

J. Yu, S. V. Vishwanathan, S. Günter, and N. N. Schraudolph, A stochastic quasi-Newton method for online convex optimization, J. Mach. Learn. Res, vol.11, pp.1145-1200, 2010.

R. H. Byrd, S. L. Hansen, J. Nocedal, and Y. Singer, A Stochastic Quasi-Newton Method for Large-Scale Optimization, SIAM Journal on Optimization, vol.26, issue.2, 2014.
DOI : 10.1137/140954362

J. M. Bioucas-dias and M. A. Figueiredo, A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration, IEEE Transactions on Image Processing, vol.16, issue.12, pp.2992-3004, 2007.
DOI : 10.1109/TIP.2007.909319