Skip to Main content Skip to Navigation
Journal articles

Multi-level stochastic approximation algorithms

Abstract : This paper studies multi-level stochastic approximation algorithms. Our aim is to extend the scope of the multilevel Monte Carlo method recently introduced by Giles (Giles 2008) to the framework of stochastic optimization by means of stochastic approximation algorithm. We first introduce and study a two-level method, also referred as statistical Romberg stochastic approximation algorithm. Then, its extension to multi-level is proposed. We prove a central limit theorem for both methods and describe the possible optimal choices of step size sequence. Numerical results confirm the theoretical analysis and show a significant reduction in the initial computational cost.
Document type :
Journal articles
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00870585
Contributor : Noufel Frikha <>
Submitted on : Wednesday, August 6, 2014 - 6:43:15 PM
Last modification on : Saturday, March 28, 2020 - 2:16:18 AM
Document(s) archivé(s) le : Tuesday, April 11, 2017 - 6:22:30 PM

Files

MultLevelSA.pdf
Files produced by the author(s)

Identifiers

Citation

Noufel Frikha. Multi-level stochastic approximation algorithms. Annals of Applied Probability, Institute of Mathematical Statistics (IMS), 2016, 26 (2), pp.933-985. ⟨10.1214/15-AAP1109⟩. ⟨hal-00870585v2⟩

Share

Metrics

Record views

572

Files downloads

651