Optimal Stopping for Change-point Detection of Piecewise Deterministic Markov Processes

Alice Cleynen 1 Benoîte de Saporta 2, 1
2 CQFD - Quality control and dynamic reliability
IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : We consider a problem of change point detection for a continuous-time stochastic process in the family of piecewise deterministic Markov processes introduced by MHA Davis in the 80's. The process is only observed in discrete time and with noise, and the aim is to accurately detect the (random) time when its dynamics change and also select the new dynamics among a finite number of possibilities as soon as possible after the change-point. To do so, we turn the detection problem into an optimal stopping problem for partially observed Markov decision process with values in a continuous state space, and provide a discretization of the state space to be able to solve the problem numerically. Applications include for instance maintenance optimization where the change-point corresponds to a failure time of some equipment. Another application concerns treatment optimization for cancer patients. The change-point then corresponds to a sudden deterioration of the health of the patient. It must be detected early so that the treatment can be adapted.
Document type :
Conference papers
Liste complète des métadonnées

Cited literature [1 references]  Display  Hide  Download

Contributor : Benoîte de Saporta <>
Submitted on : Monday, July 17, 2017 - 2:16:20 PM
Last modification on : Thursday, December 13, 2018 - 2:16:03 PM


Files produced by the author(s)


  • HAL Id : hal-01563234, version 1


Alice Cleynen, Benoîte de Saporta. Optimal Stopping for Change-point Detection of Piecewise Deterministic Markov Processes. CT 2017 - SIAM Conference on Control and Its Applications , 2017, Pittsburgh, United States. ⟨hal-01563234⟩



Record views


Files downloads