Time Blocks Decomposition of Multistage Stochastic Optimization Problems

Abstract : Multistage stochastic optimization problems are, by essence, complex because their solutions are indexed both by stages (time) and by uncertainties (scenarios). Their large scale nature makes decomposition methods appealing. The most common approaches are time decomposition --- and state-based resolution methods, like stochastic dynamic programming, in stochastic optimal control --- and scenario decomposition --- like progressive hedging in stochastic programming. We present a method to decompose multistage stochastic optimization problems by time blocks, which covers both stochastic programming and stochastic dynamic programming. Once established a dynamic programming equation with value functions defined on the history space (a history is a sequence of uncertainties and controls), we provide conditions to reduce the history using a compressed ``state'' variable. This reduction is done by time blocks, that is, at stages that are not necessarily all the original unit stages, and we prove a reduced dynamic programming equation. Then, we apply the reduction method by time blocks to \emph{two time-scales} stochastic optimization problems and to a novel class of so-called \emph{decision-hazard-decision} problems, arising in many practical situations, like in stock management. The \emph{time blocks decomposition} scheme is as follows: we use dynamic programming at slow time scale where the slow time scale noises are supposed to be stagewise independent, and we produce slow time scale Bellman functions; then, we use stochastic programming at short time scale, within two consecutive slow time steps, with the final short time scale cost given by the slow time scale Bellman functions, and without assuming stagewise independence for the short time scale noises.
Document type :
Preprints, Working Papers, ...
Liste complète des métadonnées

Contributor : Michel de Lara <>
Submitted on : Wednesday, September 26, 2018 - 6:18:34 PM
Last modification on : Wednesday, October 31, 2018 - 12:57:23 PM


Files produced by the author(s)


  • HAL Id : hal-01757113, version 2
  • ARXIV : 1804.01711


Pierre Carpentier, Jean-Philippe Chancelier, Michel de Lara, Tristan Rigaut. Time Blocks Decomposition of Multistage Stochastic Optimization Problems. 2018. ⟨hal-01757113v2⟩



Record views


Files downloads