Sparse hierarchical interaction learning with epigraphical projection

Abstract : This work focuses on learning optimization problems with quadratical interactions between variables, which go beyond the additive models of traditional linear learning. We investigate more specifically two different methods encountered in the literature to deal with this problem: "hierNet" and structured-sparsity regularization, and study their connections. We propose a primal-dual proximal algorithm based on an epi-graphical projection to optimize a general formulation of these learning problems. The experimental setting first highlights the improvement of the proposed procedure compared to state-of-the-art methods based on fast iterative shrinkage-thresholding algorithm (i.e. FISTA) or alternating direction method of multipliers (i.e. ADMM), and then, using the proposed flexible optimization framework, we provide fair comparisons between the different hierarchical penalizations and their improvement over the standard 1-norm penalization. The experiments are conducted both on synthetic and real data, and they clearly show that the proposed primal-dual proximal algorithm based on epigraphical projection is efficient and effective to solve and investigate the problem of hierarchical interaction learning. * This is a pre-print of an article published in Journal of Signal Processing Systems. The final authenticated version is available online at: https://doi.org/[insert DOI]. Corresponding author N. Pustelnik
Document type :
Journal articles
Complete list of metadatas

Cited literature [45 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02349350
Contributor : Nelly Pustelnik <>
Submitted on : Tuesday, November 5, 2019 - 4:08:41 PM
Last modification on : Thursday, December 5, 2019 - 1:30:35 AM

File

1705.07817.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02349350, version 1

Collections

Citation

Mingyuan Jiu, Nelly Pustelnik, Stefan Janaqi, Mèriam Chèbre, Lin Qi, et al.. Sparse hierarchical interaction learning with epigraphical projection. Journal of Signal Processing Systems, Springer, In press. ⟨hal-02349350⟩

Share

Metrics

Record views

23

Files downloads

42