Skip to Main content Skip to Navigation
Conference papers

Adaptive Whole-Body Manipulation in Human-to-Humanoid Multi-Contact Motion Retargeting

Kazuya Otani 1 Karim Bouyarmane 1, 2
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : We propose a multi-robot quadratic program (QP) controller for retargeting of a human's multi-contact loco-manipulation motions to a humanoid robot. Using this framework , the robot can track complex motions and automatically adapt to objects in the environment that have different physical properties from those that were used to provide the human's reference motion. The whole-body multi-contact manipulation problem is formulated as a multi-robot QP, which optimizes over the combined dynamics of the robot and any manipulated objects. The multi-robot QP maintains a dynamic partition of the robot's tracking links into fixed support contact, manipulation contact, and contact-free tracking links, which are re-partitioned and re-instantiated as constraints in the multi-robot QP every time a contact event occurs in the human motion. We present various experiments (bag retrieval, door opening, box lifting) using human motion data from an Xsens inertial motion capture system. We show in full-body dynamics simulation that the robot is able to perform difficult single-stance motions as well as multi-contact-stance motions (including hand supports), while adapting to objects of varying inertial properties.
Document type :
Conference papers
Complete list of metadata
Contributor : Karim Bouyarmane Connect in order to contact the contributor
Submitted on : Tuesday, December 5, 2017 - 5:42:34 PM
Last modification on : Saturday, October 16, 2021 - 11:26:09 AM


Files produced by the author(s)


  • HAL Id : hal-01569390, version 2




Kazuya Otani, Karim Bouyarmane. Adaptive Whole-Body Manipulation in Human-to-Humanoid Multi-Contact Motion Retargeting. HUMANOIDS 2017 - IEEE-RAS International Conference on Humanoid Robots, Nov 2017, Birmingham, United Kingdom. pp.1-8. ⟨hal-01569390v2⟩



Record views


Files downloads