A Random Block-Coordinate Douglas-Rachford Splitting Method with Low Computational Complexity for Binary Logistic Regression

Abstract : In this paper, we propose a new optimization algorithm for sparse logistic regression based on a stochastic version of the Douglas-Rachford splitting method. Our algorithm sweeps the training set by randomly selecting a mini-batch of data at each iteration, and it allows us to update the variables in a block coordinate manner. Our approach leverages the proximity operator of the logistic loss, which is expressed with the generalized Lambert W function. Experiments carried out on standard datasets demonstrate the efficiency of our approach w.r.t. stochastic gradient-like methods.
Liste complète des métadonnées

Cited literature [45 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01672507
Contributor : Giovanni Chierchia <>
Submitted on : Monday, December 25, 2017 - 9:50:25 PM
Last modification on : Wednesday, February 13, 2019 - 6:46:02 PM

File

main_optim_LB3.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01672507, version 1

Citation

Luis Briceño-Arias, Giovanni Chierchia, Emilie Chouzenoux, Jean-Christophe Pesquet. A Random Block-Coordinate Douglas-Rachford Splitting Method with Low Computational Complexity for Binary Logistic Regression. 2017. ⟨hal-01672507⟩

Share

Metrics

Record views

359

Files downloads

121