Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant

Sofia Zaidenberg 1 Patrick Reignier 1, *
* Corresponding author
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : New technologies bring a multiplicity of new possibilities for users to work with computers. Not only are spaces more and more equipped with stationary computers or notebooks, but more and more users carry mobile devices with them (smart-phones, personal digital assistants, etc.). Ubiquitous computing aims at creating smart environments where devices are dynamically linked in order to provide new services to users and new human-machine interaction possibilities. The most profound technologies are those that disappear. They weave themselves into the fabric of everyday life until they are indistinguishable from it (Weiser, 1991). This network of devices must perceive the context in order to understand and anticipate the user's needs. Devices should be able to execute actions that help the user to fulfill his goal or that simply accommodate him. Actions depend on the user's context and, in particular, on the situation within the context. The objective of this work is to construct automatically a context model by applying reinforcement learning techniques. Rewards are given by the user when expressing his degree of satisfaction towards actions proposed by the system. A default context model is used from the beginning in order to have a consistent initial behavior. This model is then adapted to each particular user in a way that maximizes the user's satisfaction towards the system's actions.
Complete list of metadatas

Cited literature [36 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00753245
Contributor : Patrick Reignier <>
Submitted on : Sunday, November 18, 2012 - 10:03:53 PM
Last modification on : Tuesday, November 27, 2018 - 8:46:03 PM
Long-term archiving on : Thursday, February 21, 2013 - 11:01:06 AM

File

chapter.pdf
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Sofia Zaidenberg, Patrick Reignier. Reinforcement Learning of User Preferences for a Ubiquitous Personal Assistant. Abdelhamid Mellouk. Advances in Reinforcement Learning, Intech, pp.59-80, 2011, 978-953-307-369-9. ⟨10.5772/13723⟩. ⟨hal-00753245⟩

Share

Metrics

Record views

814

Files downloads

566