Towards vision-based manipulation of plastic materials

Andrea Cherubini 1 Jürgen Leitner 2 Valerio Ortenzi 2 Peter Corke 2
1 IDH - Interactive Digital Humans
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : This paper represents a step towards vision-based manipulation of plastic materials. Manipulating deformable objects is made challenging by: 1) the absence of a model for the object deformation, 2) the inherent difficulty of visual tracking of deformable objects, 3) the difficulty in defining a visual error and 4) the difficulty in generating control inputs to minimise the visual error. We propose a novel representation of the task of manipulating deformable objects. In this preliminary case study, the shaping of kinetic sand, we assume a finite set of actions: pushing, tapping and incising. We consider that these action types affect only a subset of the state, i.e., their effect does not affect the entire state of the system (specialized actions). We report the results of a user study to validate these hypotheses and release the recorded dataset. The actions (pushing, tapping and incising) are clearly adopted during the task, although it is clear that 1) participants use also mixed actions and 2) actions' effects can marginally affect the entire state, requesting a relaxation of our specialized actions hypothesis. Moreover, we compute task errors and corresponding control inputs (in the image space) using image processing. Finally, we show how machine learning can be applied to infer the mapping from error to action on the data extracted from the user study.
Type de document :
Communication dans un congrès
IEEE/RSJ IROS, 2018, Madrid, Spain. 2018
Liste complète des métadonnées

Littérature citée [16 références]  Voir  Masquer  Télécharger
Contributeur : Cherubini Andrea <>
Soumis le : mercredi 14 mars 2018 - 00:57:13
Dernière modification le : jeudi 24 mai 2018 - 15:59:24
Document(s) archivé(s) le : vendredi 15 juin 2018 - 12:38:30


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01731230, version 1



Andrea Cherubini, Jürgen Leitner, Valerio Ortenzi, Peter Corke. Towards vision-based manipulation of plastic materials. IEEE/RSJ IROS, 2018, Madrid, Spain. 2018. 〈hal-01731230〉



Consultations de la notice


Téléchargements de fichiers