Skip to Main content Skip to Navigation
Journal articles

Effects of system parameters on the optimal cost and policy in a class of multidimensional queueing control problems

Abstract : We consider a class of Markov Decision Processes frequently employed to model queueing and inventory control problems. For these problems, we explore how changes in different system input parameters (transition rates, costs, discount rates etc.) affect the optimal cost and the optimal policy when the state space of the problem is multidimensional. To address a large class of problems, we introduce two generic dynamic programming operators to model different types of controlled events. For these operators, we derive sufficient conditions to propagate monotonicity and supermodularity properties of the value function. These properties allow to predict how changes in system input parameters affect the optimal cost and policy. Finally, we explore the case when several parameters are changed at the same time. © 2017 INFORMS.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-01858481
Contributor : Hal Disp <>
Submitted on : Monday, August 20, 2018 - 6:25:01 PM
Last modification on : Wednesday, February 24, 2021 - 4:24:02 PM

Identifiers

Citation

Samuel Vercraene, Jean-Philippe Gayon, Fikri Karaesmen. Effects of system parameters on the optimal cost and policy in a class of multidimensional queueing control problems. Operations Research, INFORMS, 2018, 66 (1), pp.150-162. ⟨10.1287/opre.2017.1600⟩. ⟨hal-01858481⟩

Share

Metrics

Record views

147