# Numerical method for optimal stopping of piecewise deterministic Markov processes

3 CQFD - Quality control and dynamic reliability
IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : The aim of this paper is to propose a computational method for optimal stopping of a piecewise deterministic Markov process by using a quantization technique for an underlying discrete-time Markov chain related to the continuous-time process and path-adapted time discretization grids. Piecewise-deterministic Markov processes (PDMP's) have been introduced in the literature by M.H.A. Davis \cite{davis93} as a general class of stochastic models covering a great number of problems of operations research. PDMP's are a family of Markov processes involving deterministic motion punctuated by random jumps. It was shown in \cite{gugerli86} that the value function of the optimal stopping problem can be calculated by iterating a functional operator which involves a continuous-time maximization and a discrete-time dynamic programming formula. To approximate the value function of the optimal stopping problem of a PDMP, a natural approach would have been to follow the same lines as in \cite{bally03} for diffusion processes, unfortunately their method cannot be directly applied here. However, by using the special structure of PDMP's, we are able to propose an approximation scheme for the value function and derive a rate of convergence. In addition and more importantly, this numerical approximation scheme enables us to propose, without any additional calculations, a computable stopping rule which also is an $\epsilon$-optimal stopping time of the original problem, and we can characterize how far it is from optimal in terms of the value function.
Document type :
Conference papers
Domain :

https://hal.archives-ouvertes.fr/hal-00400183
Contributor : Benoîte de Saporta <>
Submitted on : Tuesday, June 30, 2009 - 10:20:11 AM
Last modification on : Wednesday, December 5, 2018 - 9:02:05 AM

### Identifiers

• HAL Id : hal-00400183, version 1

### Citation

Benoîte de Saporta, François Dufour, Karen Gonzalez. Numerical method for optimal stopping of piecewise deterministic Markov processes. OPTIMAL STOPPING WITH APPLICATIONS, Jun 2009, Turku, Finland. ⟨hal-00400183⟩

Record views