HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Acquisition and use of transferable, spatio-temporal plan representations for human-robot interaction

Abstract : Service robots that work together with humans in domestic and constantly changing environments should have a general understanding about their human partners and the tasks that are to be performed. This would enable them to verify their beliefs about the common tasks and the goals of their human partners and detect unexpected events and failures. In this paper we present a way of acquiring general, spatio-temporal plan representations from human motion tracking data in different environments. Using an annotated data set for table setting tasks in a typical kitchen environment, we first cluster the static positions of the participants and create a spatial model relative to furniture objects that are given by a semantic map and linked to a knowledge base. Based on this spatial model learned in one kitchen, we automatically generate spatio-temporal plan representations in different kitchen environments with known semantic maps. We show that our models can successfully be used to give a robot a basic understanding about a task executed by a human in three different environments. We evaluate the quality of our automatic generation of the plan representations and present an example application of plan supervision using a learned model from one kitchen to differentiate tasks performed by humans in other kitchens.
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download

Contributor : Alexandra Kirsch Connect in order to contact the contributor
Submitted on : Friday, August 4, 2017 - 9:02:19 AM
Last modification on : Thursday, January 6, 2022 - 11:38:04 AM


Files produced by the author(s)



Michael Karg, Alexandra Kirsch. Acquisition and use of transferable, spatio-temporal plan representations for human-robot interaction. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Oct 2012, Vilamoura, Algarve, Portugal. pp.5220 - 5226, ⟨10.1109/IROS.2012.6385487⟩. ⟨hal-01571942⟩



Record views


Files downloads