Change-point detection for Piecewise Deterministic Markov Processes - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Automatica Année : 2018

Change-point detection for Piecewise Deterministic Markov Processes

Résumé

We consider a change-point detection problem for a simple class of Piecewise Deterministic Markov Processes (PDMPs). A continuous-time PDMP is observed in discrete time and through noise, and the aim is to propose a numerical method to accurately detect both the date of the change of dynamics and the new regime after the change. To do so, we state the problem as an optimal stopping problem for a partially observed discrete-time Markov decision process taking values in a continuous state space and provide a discretization of the state space based on quantization to approximate the value function and build a tractable stopping policy. We provide error bounds for the approximation of the value function and numerical simulations to assess the performance of our candidate policy.

Dates et versions

hal-01596670 , version 1 (28-09-2017)

Identifiants

Citer

Alice Cleynen, Benoîte de Saporta. Change-point detection for Piecewise Deterministic Markov Processes. Automatica, 2018, 97, pp.234-247. ⟨10.1016/j.automatica.2018.08.011⟩. ⟨hal-01596670⟩
152 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More