M. Basseville and I. V. Nikiforov, Detection of Abrupt Changes: Theory and Application, 1993.
URL : https://hal.archives-ouvertes.fr/hal-00008518

R. Bellman, Dynamic programming. Princeton university press, 1957.

I. Chadès, J. Carwardine, T. G. Martin, S. Nicol, R. Sabbadin et al., MOMDPs: A solution for modelling adaptive management problems, p.AAAI, 2012.

S. P. Choi, D. Y. Yeung, and N. L. Zhang, Hidden-Mode Markov Decision Processes for Nonstationary Sequential Decision Making, Sequence Learning -Paradigms, Algorithms, and Applications, 2001.
DOI : 10.1007/3-540-44565-X_12

S. Choi, D. Y. Yeung, and N. Zhang, An environment model for nonstationary reinforcement learning, Advances in Neural Information Processing Systems, pp.994-1000, 2000.

K. Doya, K. Samejima, K. Ichi-katagiri, and M. Kawato, Multiple Model-Based Reinforcement Learning, Neural Computation, vol.3, issue.6, pp.1347-1369, 2002.
DOI : 10.1016/S1364-6613(98)01221-2

B. Ghosh and P. Sen, Handbook of Sequential Analysis, 1991.

E. Hadoux, A. Beynier, and P. Weng, Solving Hidden-Semi-Markov-Mode Markov Decision Problems, 8th Int. Conf. on Scalable Uncertainty Management (SUM), 2014.
DOI : 10.1007/978-3-319-11508-5_15
URL : https://hal.archives-ouvertes.fr/hal-01200812

R. Howard, Dynamic Programming and Markov Processes. The M.I, 1960.

T. L. Lai, Sequential analysis: Some classical problems and new challenges, Statistica Sinica, vol.11, pp.303-408, 2001.

K. Narendra, J. Balakrishnan, and M. Ciliz, Adaptation and learning using multiple models, switching, and tuning, IEEE Control Systems Magazine, vol.15, issue.3, pp.37-51, 1995.
DOI : 10.1109/37.387616

S. C. Ong, S. W. Png, D. Hsu, and W. S. Lee, Planning under Uncertainty for Robotic Tasks with Mixed Observability, The International Journal of Robotics Research, vol.21, issue.3, pp.1053-1068, 2010.
DOI : 10.1177/0278364910369861

M. Puterman, Markov decision processes: discrete stochastic dynamic programming, 1994.
DOI : 10.1002/9780470316887

B. C. Da-silva, D. W. Basso, A. L. Bazzan, and P. M. Engel, Dealing with nonstationary environments using context detection, Proceedings of the 23rd International Conference on Machine Learning, 2006.

R. Sutton and A. Barto, Reinforcement Learning: An Introduction, IEEE Transactions on Neural Networks, vol.9, issue.5, 1998.
DOI : 10.1109/TNN.1998.712192

A. Wald, Sequential Tests of Statistical Hypotheses, The Annals of Mathematical Statistics, vol.16, issue.2, pp.117-186, 1945.
DOI : 10.1214/aoms/1177731118