Deep neural networks algorithms for stochastic control problems on finite horizon: numerical applications

Abstract : This paper presents several numerical applications of deep learning-based algorithms that have been introduced in [HPBL18]. Numerical and comparative tests using TensorFlow illustrate the performance of our different algorithms, namely control learning by performance iteration (algorithms NNcontPI and ClassifPI), control learning by hybrid iteration (algorithms Hybrid-Now and Hybrid-LaterQ), on the 100-dimensional nonlinear PDEs examples from [EHJ17] and on quadratic backward stochastic differential equations as in [CR16]. We also performed tests on low-dimension control problems such as an option hedging problem in finance, as well as energy storage problems arising in the valuation of gas storage and in microgrid management. Numerical results and comparisons to quantization-type algorithms Qknn, as an efficient algorithm to numerically solve low-dimensional control problems, are also provided; and some corresponding codes are available on https://github.com/comeh/.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01949221
Contributor : Côme Huré <>
Submitted on : Friday, May 17, 2019 - 5:43:53 PM
Last modification on : Tuesday, July 9, 2019 - 3:58:02 PM

Files

Deepconsto-Partie2_rev2.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01949221, version 2
  • ARXIV : 1812.05916

Citation

Achref Bachouch, Côme Huré, Nicolas Langrené, Huyen Pham. Deep neural networks algorithms for stochastic control problems on finite horizon: numerical applications. 2019. ⟨hal-01949221v2⟩

Share

Metrics

Record views

65

Files downloads

133