Skip to Main content Skip to Navigation
Conference papers

Approximation of Lorenz-Optimal Solutions in Multiobjective Markov Decision Processes

Patrice Perny 1 Paul Weng 1 Judy Goldsmith Josiah Hanna
1 DECISION
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : This paper is devoted to fair optimization in Multiobjective Markov Decision Processes (MOMDPs). A MOMDP is an extension of the MDP model for planning under uncertainty while trying to optimize several reward functions simultaneously. This applies to multiagent problems when rewards define individual utility functions, or in multicriteria problems when rewards refer to different features. In this setting, we study the determination of policies leading to Lorenz-non-dominated tradeoffs. Lorenz dominance is a refinement of Pareto dominance that was introduced in Social Choice for the measurement of inequalities. In this paper, we introduce methods to efficiently approximate the sets of Lorenz-non-dominated solutions of infinite-horizon, discounted MOMDPs. The approximations are polynomial-sized subsets of those solutions.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01216091
Contributor : Lip6 Publications <>
Submitted on : Thursday, October 15, 2015 - 3:29:16 PM
Last modification on : Thursday, March 21, 2019 - 2:32:53 PM

Identifiers

  • HAL Id : hal-01216091, version 1

Citation

Patrice Perny, Paul Weng, Judy Goldsmith, Josiah Hanna. Approximation of Lorenz-Optimal Solutions in Multiobjective Markov Decision Processes. Conference on Uncertainty in Artificial Intelligence, UAI 2013, Jul 2013, Bellevue, Washington, United States. pp.Id 208. ⟨hal-01216091⟩

Share

Metrics

Record views

62