Skip to Main content Skip to Navigation
Journal articles

Properties of the sign gradient descent algorithms

Abstract : The aim of this article is to study the properties of the sign gradient descent algorithms involving the sign of the gradient instead of the gradient itself and first introduced in the RPROP algorithm. This article provides two results of convergence for local optimization, a first one for nominal systems without uncertainty and a second one for systems with uncertainties. New sign gradient descent algorithms including the dichotomy algorithm DICHO are applied on several examples to show their effectiveness in terms of speed of convergence. As a novelty, the sign gradient descent algorithms can allow to converge in practice towards other minima than the closest minimum of the initial condition making these algorithms suitable for global optimization as a new metaheuristic method.
Complete list of metadata

Cited literature [50 references]  Display  Hide  Download
Contributor : Emmanuel Moulay <>
Submitted on : Friday, February 21, 2020 - 3:38:13 PM
Last modification on : Tuesday, January 5, 2021 - 4:26:08 PM
Long-term archiving on: : Friday, May 22, 2020 - 4:11:01 PM


Properties of the sign gradien...
Files produced by the author(s)



Emmanuel Moulay, Vincent Léchappé, Franck Plestan. Properties of the sign gradient descent algorithms. Information Sciences, Elsevier, 2019, ⟨10.1016/j.ins.2019.04.012⟩. ⟨hal-02096241⟩



Record views


Files downloads