Optimal Stopping for Change-point Detection of Piecewise Deterministic Markov Processes

Alice Cleynen 1 Benoîte De Saporta 1, 2
2 CQFD - Quality control and dynamic reliability
IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Abstract : We consider a problem of change point detection for a continuous-time stochastic process in the family of piecewise deterministic Markov processes introduced by MHA Davis in the 80's. The process is only observed in discrete time and with noise, and the aim is to accurately detect the (random) time when its dynamics change and also select the new dynamics among a finite number of possibilities as soon as possible after the change-point. To do so, we turn the detection problem into an optimal stopping problem for partially observed Markov decision process with values in a continuous state space, and provide a discretization of the state space to be able to solve the problem numerically. Applications include for instance maintenance optimization where the change-point corresponds to a failure time of some equipment. Another application concerns treatment optimization for cancer patients. The change-point then corresponds to a sudden deterioration of the health of the patient. It must be detected early so that the treatment can be adapted.
Type de document :
Communication dans un congrès
CT 2017 - SIAM Conference on Control and Its Applications , 2017, Pittsburgh, United States. 2017, 〈http://www.siam.org/meetings/ct17/index.php〉
Liste complète des métadonnées

Littérature citée [1 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01563234
Contributeur : Benoîte De Saporta <>
Soumis le : lundi 17 juillet 2017 - 14:16:20
Dernière modification le : mercredi 19 juillet 2017 - 01:06:31

Fichier

SIAM-CT17-MS10-deSAPORTA.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01563234, version 1

Citation

Alice Cleynen, Benoîte De Saporta. Optimal Stopping for Change-point Detection of Piecewise Deterministic Markov Processes. CT 2017 - SIAM Conference on Control and Its Applications , 2017, Pittsburgh, United States. 2017, 〈http://www.siam.org/meetings/ct17/index.php〉. 〈hal-01563234〉

Partager

Métriques

Consultations de
la notice

96

Téléchargements du document

27