Reaching optimally over the workspace: a machine learning approach

Didier Marin (1, 2) , Olivier Sigaud (1, 2)

1 ISIR - Institut des Systèmes Intelligents et de Robotique
2 AMAC

Recent theories of Human Motor Control explain our outstanding coordination capabilities by calling upon an Optimal Control (OC) framework. But OC methods are generally too expensive to be applied on-line and in real- time as would be required to perform everyday movements. An alternative method consists in obtaining a pre-computed feedback policy that performs optimally while being executed reactively. One way to get such a pre-computed policy consists in tuning a parametrized reactive controller so that it converges to optimal behavior. In this paper, we demonstrate a method to obtain such a reactive controller that (i) adapts the time of movement based on a compromise between the amount of reward and the effort required to get it, (ii) provides an efficient trajectory from any point to any point in the workspace, (iii) learns from demonstrations of optimal trajectories, (iv) is improving its performance over accumulated experience.

Domaines: Intelligence artificielle [cs.AI]

Didier Marin, Olivier Sigaud. Reaching optimally over the workspace: a machine learning approach. The Fourth IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, Jun 2012, Roma, Italy. pp.1128-1133, ⟨10.1109/BioRob.2012.6290743⟩. ⟨hal-00743371⟩