Skip to Main content Skip to Navigation
Journal articles

Properties of the sign gradient descent algorithms

Abstract : The aim of this article is to study the properties of the sign gradient descent algorithms involving the sign of the gradient instead of the gradient itself and first introduced in the RPROP algorithm. This article provides two results of convergence for local optimization, a first one for nominal systems without uncertainty and a second one for systems with uncertainties. New sign gradient descent algorithms including the dichotomy algorithm DICHO are applied on several examples to show their effectiveness in terms of speed of convergence. As a novelty, the sign gradient descent algorithms can allow to converge in practice towards other minima than the closest minimum of the initial condition making these algorithms suitable for global optimization as a new metaheuristic method.
Complete list of metadatas

Cited literature [50 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02096241
Contributor : Emmanuel Moulay <>
Submitted on : Friday, February 21, 2020 - 3:38:13 PM
Last modification on : Tuesday, April 7, 2020 - 2:03:30 AM

File

Properties of the sign gradien...
Files produced by the author(s)

Identifiers

Citation

Emmanuel Moulay, Vincent Léchappé, Franck Plestan. Properties of the sign gradient descent algorithms. Information Sciences, Elsevier, 2019, ⟨10.1016/j.ins.2019.04.012⟩. ⟨hal-02096241⟩

Share

Metrics

Record views

171

Files downloads

95