Skip to Main content Skip to Navigation
Book sections

Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant

Sofia Zaidenberg 1 Patrick Reignier 1, *
* Corresponding author
1 PRIMA - Perception, recognition and integration for observation of activity
CNRS - Centre National de la Recherche Scientifique : UMR5217, INPG - Institut National Polytechnique de Grenoble , UJF - Université Joseph Fourier - Grenoble 1, Inria Grenoble - Rhône-Alpes
Abstract : New technologies bring a multiplicity of new possibilities for users to work with computers. Not only are spaces more and more equipped with stationary computers or notebooks, but more and more users carry mobile devices with them (smart-phones, personal digital assistants, etc.). Ubiquitous computing aims at creating smart environments where devices are dynamically linked in order to provide new services to users and new human-machine interaction possibilities. The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it (Weiser, 1991). This network of devices must perceive the context in order to understand and anticipate the user's needs. Devices should be able to execute actions that help the user to fulfill his goal or that simply accommodate him. Actions depend on the user's context and, in particular, on the situation within the context. The objective of this work is to construct automatically a context model by applying reinforcement learning techniques. Rewards are given by the user when expressing his degree of satisfaction towards actions proposed by the system. A default context model is used from the beginning in order to have a consistent initial behavior. This model is then adapted to each particular user in a way that maximizes the user's satisfaction towards the system's actions.
Complete list of metadata

Cited literature [36 references]  Display  Hide  Download
Contributor : Patrick Reignier Connect in order to contact the contributor
Submitted on : Sunday, November 18, 2012 - 10:03:53 PM
Last modification on : Thursday, January 20, 2022 - 5:28:30 PM
Long-term archiving on: : Thursday, February 21, 2013 - 11:01:06 AM


Publisher files allowed on an open archive




Sofia Zaidenberg, Patrick Reignier. Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant. Abdelhamid Mellouk. Advances in Reinforcement Learning, Intech, pp.59-80, 2011, 978-953-307-369-9. ⟨10.5772/13723⟩. ⟨hal-00753245⟩



Les métriques sont temporairement indisponibles