Computing rank dependent utility in graphical models for sequential decision problems

Gildas Jeantet 1 Olivier Spanjaard 1
1 DECISION
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : This paper is devoted to automated sequential decision in AI. More precisely, we focus here on the Rank Dependent Utility (RDU) model. This model is able to encompass rational decision behaviors that the Expected Utility model cannot accommodate. However, the non-linearity of RDU makes it difficult to compute an RDU-optimal strategy in sequential decision problems. This has considerably slowed the use of RDU in operational contexts. In this paper, we are interested in providing new algorithmic solutions to compute an RDU-optimal strategy in graphical models. Specifically, we present algorithms for solving decision tree models and influence diagram models of sequential decision problems. For decision tree models, we propose a mixed integer programming formulation that is valid for a subclass of RDU models (corresponding to risk seeking behaviors). This formulation reduces to a linear program when mixed strategies are considered. In the general case (i.e., when there is no particular assumption on the parameters of RDU), we propose a branch and bound procedure to compute an RDU-optimal strategy among the pure ones. After highlighting the difficulties induced by the use of RDU in influence diagram models, we show how this latter procedure can be extended to optimize RDU in an influence diagram. Finally, we provide empirical evaluations of all the presented algorithms.
Type de document :
Article dans une revue
Artificial Intelligence, Elsevier, 2011, 175 (7-8), pp.1366-1389. 〈10.1016/j.artint.2010.11.019〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01170289
Contributeur : Lip6 Publications <>
Soumis le : jeudi 13 juillet 2017 - 16:40:30
Dernière modification le : mercredi 21 mars 2018 - 18:58:09
Document(s) archivé(s) le : mercredi 24 janvier 2018 - 18:42:15

Fichier

pub_1424_1_AIJ10.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Gildas Jeantet, Olivier Spanjaard. Computing rank dependent utility in graphical models for sequential decision problems. Artificial Intelligence, Elsevier, 2011, 175 (7-8), pp.1366-1389. 〈10.1016/j.artint.2010.11.019〉. 〈hal-01170289〉

Partager

Métriques

Consultations de la notice

184

Téléchargements de fichiers

34