Skip to Main content Skip to Navigation
Conference papers

Analyse de sensibilité dans une classe de processus de décision markoviens

Samuel Vercraene 1 Jean-Philippe Gayon 1 Fikri Karaesmen 2
1 G-SCOP_GCSP - Gestion et Conduite des Systèmes de Production
G-SCOP - Laboratoire des sciences pour la conception, l'optimisation et la production
Abstract : We focus on the class of queuing system control problem involving a cost minimization or a reward maximization. It is well established that in many of these problems the optimal policy is a state dependent threshold policy. When several system parameters values are changed, we show that it is sometimes possible to predict the evolution of optimal policy. Our approach is based on the propagation of certain properties of the MDP formalization value function. We illustrate this study on two instances, a tandem queue in production/inventory context and a admission control problem.
Document type :
Conference papers
Complete list of metadata

Cited literature [8 references]  Display  Hide  Download
Contributor : Samuel Vercraene <>
Submitted on : Saturday, February 16, 2013 - 3:05:29 PM
Last modification on : Tuesday, November 24, 2020 - 4:18:02 PM
Long-term archiving on: : Friday, May 17, 2013 - 3:53:24 AM


Files produced by the author(s)


  • HAL Id : hal-00789175, version 1



Samuel Vercraene, Jean-Philippe Gayon, Fikri Karaesmen. Analyse de sensibilité dans une classe de processus de décision markoviens. ROADEF 2013, Feb 2013, Troyes, France. ⟨hal-00789175⟩



Record views


Files downloads