Planning in Partially Observable Domains with Fuzzy Epistemic States and Probabilistic Dynamics

Abstract : A new translation from Partially Observable MDP into Fully Observable MDP is described here. Unlike the classical translation, the resulting problem state space is finite, making MDP solvers able to solve this simplified version of the initial partially observable problem: this approach encodes agent beliefs with possibility distributions over states, leading to an MDP whose state space is a finite set of epistemic states. After a short description of the POMDP framework as well as notions of Possibility Theory, the translation is described in a formal manner with semantic arguments. Then actual computations of this transformation are detailed, in order to highly benefit from the factored structure of the initial POMDP in the final MDP size reduction and structure. Finally size reduction and tractability of the resulting MDP is illustrated on a simple POMDP problem.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01303819
Contributor : Open Archive Toulouse Archive Ouverte (oatao) <>
Submitted on : Monday, April 18, 2016 - 4:34:50 PM
Last modification on : Friday, October 11, 2019 - 8:22:49 PM
Long-term archiving on : Tuesday, July 19, 2016 - 2:57:21 PM

File

drougard_15481.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Nicolas Drougard, Didier Dubois, Jean-Loup Farges, Florent Teichteil-Königsbuch. Planning in Partially Observable Domains with Fuzzy Epistemic States and Probabilistic Dynamics. 9th International Conference on Scalable Uncertainty Management (SUM 2015), Sep 2015, Quebec, Canada. pp.220-233, ⟨10.1007/978-3-319-23540-0_15⟩. ⟨hal-01303819⟩

Share

Metrics

Record views

204

Files downloads

159