Skip to Main content Skip to Navigation
Conference papers

Coping with the variability in humans reward during simulated human-robot interactions through the coordination of multiple learning strategies

Abstract : An important current challenge in Human-Robot Interaction (HRI) is to enable robots to learn on-the-fly from human feedback. However, humans show a great variability in the way they reward robots. We propose to address this issue by enabling the robot to combine different learning strategies, namely model-based (MB) and model-free (MF) reinforcement learning. We simulate two HRI scenarios: a simple task where the human congratulates the robot for putting the right cubes in the right boxes, and a more complicated version of this task where cubes have to be placed in a specific order. We show that our existing MB-MF coordination algorithm previously tested in robot navigation works well here without retuning parameters. It leads to the maximal performance while producing the same minimal computational cost as MF alone. Moreover, the algorithm gives a robust performance no matter the variability of the simulated human feedback, while each strategy alone is impacted by this variability. Overall, the results suggest a promising way to promote robot learning flexibility when facing variable human feedback.
Complete list of metadata

Cited literature [19 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02899767
Contributor : Benoît Girard <>
Submitted on : Wednesday, July 15, 2020 - 2:47:05 PM
Last modification on : Thursday, March 18, 2021 - 1:36:04 PM
Long-term archiving on: : Monday, November 30, 2020 - 10:39:40 PM

File

DromnelleEtAl20-LivingMachines...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02899767, version 1

Citation

Rémi Dromnelle, Benoît Girard, Erwan Renaudo, Raja Chatila, Mehdi Khamassi. Coping with the variability in humans reward during simulated human-robot interactions through the coordination of multiple learning strategies. IEEE RO-MAN 2020, Aug 2020, Naples, Italy. ⟨hal-02899767⟩

Share

Metrics

Record views

64

Files downloads

57