Optimal switching problems with an infinite set of modes: an approach by randomization and constrained backward SDEs

Marco Fuhrman (1) , Marie Amélie Morlais (2)

1 Dipartimento di Matematica
2 LMM - Laboratoire Manceau de Mathématiques

We address a general optimal switching problem over finite horizon for a stochastic system described by a differential equation driven by Brownian motion. The main novelty is the fact that we allow for infinitely many modes (or regimes, i.e. the possible values of the piecewise-constant control process). We allow all the given coefficients in the model to be path-dependent, that is, their value at any time depends on the past trajectory of the controlled system. The main aim is to introduce a suitable (scalar) backward stochastic differential equation (BSDE), with a constraint on the martingale part, that allows to give a probabilistic representation of the value function of the given problem. This is achieved by randomization of control, i.e. by introducing an auxiliary optimization problem which has the same value as the starting optimal switching problem and for which the desired BSDE representation is obtained. In comparison with the existing literature we do not rely on a system of reflected BSDE nor can we use the associated Hamilton-Jacobi-Bellman equation in our non-Markovian framework.

Mots clés: randomization of controls; backward SDEs; stochastic optimal switching

Domaines: Probabilités [math.PR]; Optimisation et contrôle [math.OC]

Marco Fuhrman, Marie Amélie Morlais. Optimal switching problems with an infinite set of modes: an approach by randomization and constrained backward SDEs. Stochastic Processes and their Applications, In press, ⟨10.1016/j.spa.2019.09.008⟩. ⟨hal-01992004v2⟩